THE THEORY OF 
DIFFERENCE SCHEMES 


Alexander A. Samarskii 




THE THEORY OF 
DIFFERENCE SCHEMES 



THE THEORY OF 
DIFFERENCE SCHEMES 


Alexander A. Samarskii 

Moscow M. V. Lomonosov State University 
Moscow, Russia 


PARCEL 




Marcel Dekker, Inc. 


New York • Base 



ISBN: 0-8247-0468-1 

This book is printed on acid-free paper. 

Headquarters 

Marcel Dekker, Inc. 

270 Madison Avenue, New York, NY 10016 
tel: 212-696-9000; fax: 212-685-4540 

Eastern Hemisphere Distribution 

Marcel Dekker AG 

Hutgasse 4, Postfach 812, CH-4001 Basel, Switzerland 
tel: 41-61-261-8482; fax: 41-61-261-8896 

World Wide Web 

http://www.dekker.com 

The publisher offers discounts on this book when ordered in bulk quantities. For more infor¬ 
mation, write to Special Sales/Professional Marketing at the headquarters address above. 

Copyright © 2001 by Marcel Dekker, Inc. All Rights Reserved. 

Neither this book nor any part may be reproduced or transmitted in any form or by any 
means, electronic or mechanical, including photocopying, microfilming, and recording, or 
by any information storage and retrieval system, without permission in writing from the 
publisher. 

Current printing (last digit): 

10 987654321 


PRINTED IN THE UNITED STATES OF AMERICA 



PURE AND APPLIED MATHEMATICS 


A Program of Monographs, Textbooks, and Lecture Notes 


EXECUTIVE EDITORS 


Earl J. Taft 
Rutgers University 
New Brunswick, New Jersey 


Zuhair Nashed 
University of Delaware 
Newark, Delaware 


EDITORIAL BOARD 


M. S. Baouendi 
University of California, 
San Diego 

Jane Cronin 
Rutgers University 

Jack K. Hale 
Georgia Institute of Technology 

S. Kobayashi 
University of California, 
Berkeley 

Marvin Marcus 
University of California, 
Santa Barbara 

W. S. Massey 
Yale University 


Anil Nerode 
Cornell University 

Donald Passman 
University of Wisconsin, 
Madison 

Fred S. Roberts 
Rutgers University 

David L. Russell 

Virginia Polytechnic Institute 

and State University 

Walter Schempp 
Universitat Siegen 

Mark Teply 

University of Wisconsin, 
Milwaukee 



MONOGRAPHS AND TEXTBOOKS IN 
PURE AND APPLIED MATHEMATICS 


1. K. Yana, Integral Formulas in Riemannian Geometry (1970) 

2. S. Kobayashi, Hyperbolic Manifolds and Holomorphic Mappings (1970) 

3. V. S. Vladimirov, Equations of Mathematical Physics (A. Jeffrey, e<±; A. Littlewood, 
trans.) (1970) 

4. B. N. Pshenichnyi, Necessary Conditions for an Extremum (L. Neustadt, translation 
ed.; K. Makowski, trans.) (1971) 

5. L Narici et a!., Functional Analysis and Valuation Theory (1971) 

6. S. S. Passman, Infinite Group Rings (1971) 

7. L Domhoff, Group Representation Theory. Part A: Ordinary Representation Theory. 
Part B: Modular Representation Theory (1971, 1972) 

8. W. Boothby and G. L. We/ss, eds., Symmetric Spaces (1972) 

9. Y. Matsushima, Differentiable Manifolds (E. T. Kobayashi, trans.) (1972) 

10. L. E. Ward, Jr., Topology (1972) 

11. A. Babakhanian, Cohomological Methods in Group Theory (1972) 

12. R. Gilmer, Multiplicative Ideal Theory (1972) 

13. J. Yeh, Stochastic Processes and the Wiener Integral (1973) 

14. J. Barros-Neto, Introduction to the Theory of Distributions (1973) 

15. R. Larsen, Functional Analysis (1973) 

16. K. Yano and S. Ishihara, Tangent and Cotangent Bundles (1973) 

17. C. Procesi, Rings with Polynomial Identities (1973) 

18. R. Hermann, Geometry, Physics, and Systems (1973) 

19. N. R. Wallach, Harmonic Analysis on Homogeneous Spaces (1973) 

20. J. Dieudonne, Introduction to the Theory of Formal Groups (1973) 

21. I. Vaisman, Cohomology and Differential Forms (1973) 

22. B.-Y. Chen, Geometry of Submanifolds (1973) 

23. M. Marcus, Finite Dimensional Multilinear Algebra (in two parts) (1973, 1975) 

24. R. Larsen, Banach Algebras (1973) 

25. R. O. Kujala and A. L. Vitter, eds., Value Distribution Theory: Part A; Part B: Deficit 
and Bezout Estimates by Wilhelm Stoll (1973) 

26. K. B. Stoiarsky, Algebraic Numbers and Diophantine Approximation (1974) 

27. A. R. Magid, The Separable Galois Theory of Commutative Rings (1974) 

28. B. R. McDonald, Finite Rings with Identity (1974) 

29. J. Satake, Linear Algebra (S. Koh et al., trans.) (1975) 

30. J. S. Golan, Localization of Noncommutative Rings (1975) 

31. G. Klambauer, Mathematical Analysis (1975) 

32. M. K. Agoston, Algebraic Topology (1976) 

33. K. R. Goodearl, Ring Theory (1976) 

34. L E. Mansfield, Linear Algebra with Geometric Applications (1976) 

35. N. J. Pullman, Matrix Theory and Its Applications (1976) 

36. B. R. McDonald, Geometric Algebra Over Local Rings (1976) 

37. C. W. Groetsch, Generalized Inverses of Linear Operators (1977) 

38. J. E. Kuczkowski and J. L. Gersting, Abstract Algebra (1977) 

39. C. O. Christenson and W. L. Voxman, Aspects of Topology (1977) 

40. M. Nagata, Field Theory (1977) 

41. R. L. Long, Algebraic Number Theory (1977) 

42. W. F. Pfeifer, Integrals and Measures (1977) 

43. R. L. Wheeden and A. Zygmund, Measure and Integral (1977) 

44. J. H. Curtiss, Introduction to Functions of a Complex Variable (1978) 

45. K. Hrbacek and T. Jech, Introduction to Set Theory (1978) 

46. W. S. Massey, Homology and Cohomology Theory (1978) 

47. M. Marcus, Introduction to Modern Algebra (1978) 

48. E. C. Young, Vector and Tensor Analysis (1978) 

49. S. B. Nadler, Jr., Hyperspaces of Sets (1978) 

50. S. K. Segal, Topics in Group Kings (1978) 

51. A. C. M. van Rooij, Non-Archimedean Functional Analysis (1978) 

52. L. Corwin and R. Szczarba, Calculus in Vector Spaces (1979) 

53. C. Sadosky, Interpolation of Operators and Singular Integrals (1979) 

54. J. Cronin, Differential Equations (1980) 

55. C. W. Groetsch, Elements of Applicable Functional Analysis (1980) 



56. I. Vaisman, Foundations of Three-Dimensional Euclidean Geometry (1980) 

57. H. I. Freedan, Deterministic Mathematical Models in Population Ecology (1980) 

58. S. B. Chae, Lebesgue Integration (1980) 

59. C. S. Rees et al., Theory and Applications of Fourier Analysis (1981) 

60. L. Nachbin, Introduction to Functional Analysis (R. M. Aron, trans.) (1981) 

61. G. O rzech and M. Orzech, Plane Algebraic Curves (1981) 

62. R. Johnsonbaugh and W. E. Pfaffenberger, Foundations of Mathematical Analysis 
(1981) 

63. W. L. Voxman and R. H. Goetschel, Advanced Calculus (1981) 

64. L. J. Corwin and R. H. Szczarba, Multivariable Calculus (1982) 

65. V. I. Istratescu, Introduction to Linear Operator Theory (1981) 

66. R. D. Jaivinen, Finite and Infinite Dimensional Linear Spaces (1981) 

67. J. K. Beem and P. E. Ehrlich, Global Lorentzian Geometry (1981) 

68. D. L Armacost, The Structure of Locally Compact Abelian Groups (1981) 

69. J. W. Brewer and M. K. Smith, eds., Emmy Noether: A Tribute (1981) 

70. K. H. Kim, Boolean Matrix Theory and Applications (1982) 

71. T. W. Wieting, The Mathematical Theory of Chromatic Plane Ornaments (1982) 

72. D. B.Gauld, Differential Topology (1982) 

73. R. L. Faber, Foundations of Euclidean and Non-Eudidean Geometry (1983) 

74. M. Carmeli, Statistical Theory and Random Matrices (1983) 

75. J. H. Carruth et al., The Theory of Topological Semigroups (1983) 

76. R. L. Faber, Differential Geometry and Relativity Theory (1983) 

77. S. Barnett, Polynomials and Linear Control Systems (1983) 

78. G. Karpilovsky, Commutative Group Algebras (1983) 

79. F. Van Oystaeyen and A. Verschoren, Relative Invariants of Rings (1983) 

80. I. Vaisman, A First Course in Differential Geometry (1984) 

81. G. W. Swan, Applications of Optimal Control Theory in Biomedidne (1984) 

82. T. Petrie and J. D. Randall, Transformation Groups on Manifolds (1984) 

83. K. Goebel and S. Reich, Uniform Convexity, Flyperbolic Geometry, and Nonexpansive 
Mappings (1984) 

84. T. Albu and C. Nastasescu, Relative Finiteness in Module Theory (1984) 

85. K. Hrbacek and T. Jech, Introduction to Set Theory: Second Edition (1984) 

86. F. Van Oystaeyen and A. Verschoren, Relative Invariants of Rings (1984) 

87. B. R. McDonald, Linear Algebra Over Commutative Rings (1984) 

88. M. Namba, Geometry of Projective Algebraic Curves (1984) 

89. G. F. Webb, Theory of Nonlinear Age-Dependent Population Dynamics (1985) 

90. M. R. Bremner et al., Tables of Dominant Weight Multiplicities for Representations of 
Simple Lie Algebras (1985) 

91. A. E. Fekete, Real Linear Algebra (1985) 

92. S. B. Chae, Flolomorphy and Calculus in Normed Spaces (1985) 

93. A. J. Jerri, Introduction to Integral Equations with Applications (1985) 

94. G. Karpilovsky, Projective Representations of Finite Groups (1985) 

95. L. Narici and E. Beckenstein, Topological Vector Spaces (1985) 

96. J. Weeks, The Shape of Space (1985) 

97. P. R. Gribik and K. O. Kortanek, Extremal Methods of Operations Research (1985) 

98. J.-A. Chao and W. A. Woyczynski, eds., Probability Theory and Flarmonic Analysis 
(1986) 

99. G. D. Crown et al., Abstract Algebra (1986) 

100. J. H. Carruth et al., The Theory of Topological Semigroups, Volume 2 (1986) 

101. R. S. Doran and V. A. Belfi, Characterizations of C*-Algebras (1986) 

102. M. W. Jeter, Mathematical Programming (1986) 

103. M. Altman, A Unified Theory of Nonlinear Operator and Evolution Equations with 
Applications (1986) 

104. A. Verschoren, Relative Invariants of Sheaves (1987) 

105. R. A. Usmani, Applied Linear Algebra (1987) 

106. P. Blass and J. Lang, Zariski Surfaces and Differential Equations in Characteristic p > 
0(1987) 

107. J. A. Reneke et al., Structured Flereditary Systems (1987) 

108. H. Busemann and B. B. Phadke, Spaces with Distinguished Geodesics (1987) 

109. R. Harte, Invertibility and Singularity for Bounded Linear Operators (1988) 

110. G. S. Ladde et al., Osdllation Theory of Differential Equations with Deviating Argu¬ 
ments (1987) 

111. L. Dudkin et al., Iterative Aggregation Theory (1987) 

112. T. Okubo, Differential Geometry (1987) 



113. D. L. Stand and M. L. Stand, Real Analysis with Point-Set Topology (1987) 

114. T. C. Gard, Introduction to Stochastic Differential Equations (1988) 

115. S. S. Abhyankar, Enumerative Combinatorics of Young Tableaux (1988) 

116. H. Strade and R. Farnsteiner, Modular Lie Algebras and Their Representations (1988) 

117. J. A. Huckaba, Commutative Rings with Zero Divisors (1988) 

118. W. D. Wallis, Combinatorial Designs (1988) 

119. W. Wipsfaw, Topological Fields (1988) 

120. G. Karpilovsky, Field Theory (1988) 

121. S. C aenepeel and F. Van Oystaeyen, Brauer Groups and the Cohomology of Graded 
Rings (1989) 

122. W. Kozlowski, Modular Function Spaces (1988) 

123. E. Lowen-Colebunders, Function Classes of Cauchy Continuous Maps (1989) 

124. M. Pavel, Fundamentals of Pattern Recognition (1989) 

125. V. Lakshmikantham et a!., Stability Analysis of Nonlinear Systems (1989) 

126. R. Sivaramaknshnan, The Classical Theory of Arithmetic Functions (1989) 

127. N. A. Watson, Parabolic Equations on an Infinite Strip (1989) 

128. K. J. Hastings, Introduction to the Mathematics of Operations Research (1989) 

129. B. Fine, Algebraic Theory of the Bianchi Groups (1989) 

130. D. N. Dikranjan et a/., Topological Groups (1989) 

131. J. C. Morgan II, Point Set Theory (1990) 

132. P. Biler and A. Witkowski, Problems in Mathematical Analysis (1990) 

133. H. J. Sussmann, Nonlinear Controllability and Optimal Control (1990) 

134. J.-P. Florens et a!., Elements of Bayesian Statistics (1990) 

135. N. Shell, Topological Fields and Near Valuations (1990) 

136. B. F. Doolin and C. F. Martin, Introduction to Differential Geometry for Engineers 
(1990) 

137. S. S. Holland, Jr., Applied Analysis by the Hilbert Space Method (1990) 

138. J. Okninski, Semigroup Algebras (1990) 

139. K. Zhu, Operator Theory in Function Spaces (1990) 

140. G. B. Price, An Introduction to Multicomplex Spaces and Functions (1991) 

141. R. B. Darst, Introduction to Linear Programming (1991) 

142. P. L. Sachdev, Nonlinear Ordinary Differential Equations and Their Applications (1991) 

143. T. Husain, Orthogonal Schauder Bases (1991) 

144. J. Foran, Fundamentals of Real Analysis (1991) 

145. W. C. Brown, Matrices and Vector Spaces (1991) 

146. M. M. Rao and Z. D. Ren, Theory of Orlicz Spaces (1991) 

147. J. S. Golan and T. Head, Modules and the Structures of Rings (1991) 

148. C. Small, Arithmetic of Finite Fields (1991) 

149. K. Yang, Complex Algebraic Geometry (1991) 

150. D. G. Hoffman et at.. Coding Theory (1991) 

151. M. O. Gonzalez, Classical Complex Analysis (1992) 

152. M. O. Gonzalez, Complex Analysis (1992) 

153. L W. Baggett, Functional Analysis (1992) 

154. M. Sniedovich, Dynamic Programming (1992) 

155. R. P. Agarwal, Difference Equations and Inequalities (1992) 

156. C. Brezinski, Biorthogonality and Its Applications to Numerical Analysis (1992) 

157. C. Swartz, An Introduction to Functional Analysis (1992) 

158. S. B. Nadler, Jr., Continuum Theory (1992) 

159. M. A. Al-Gwaiz, Theory of Distributions (1992) 

160. E. Perry, Geometry: Axiomatic Developments with Problem Solving (1992) 

161. E. Castillo and M. R. Ruiz-Cobo, Functional Equations and Modelling in Science and 
Engineering (1992) 

162. A. J. Jerri, Integral and Discrete Transforms with Applications and Error Analysis 
(1992) 

163. A. Charlieret at.. Tensors and the Clifford Algebra (1992) 

164. P. Biler and T. Nadzieja, Problems and Examples in Differential Equations (1992) 

165. E. Hansen, Global Optimization Using Interval Analysis (1992) 

166. S. Guerre-Delabnere, Classical Sequences in Banach Spaces (1992) 

167. Y. C. Wong, Introductory Theory of Topological Vector Spaces (1992) 

168. S. H. Kulkarni and B. V. Limaye, Real Function Algebras (1992) 

169. W. C. Brown, Matrices Over Commutative Rings (1993) 

170. J. Loustau and M. Dillon, Linear Geometry with Computer Graphics (1993) 

171. W. V. Petryshyn, Approximation-Solvability of Nonlinear Functional and Differential 
Equations (1993) 



172. E. C. Young, Vector and Tensor Analysis: Second Edition (1993) 

173. T. A. Bick, Elementary Boundary Value Problems (1993) 

174. M. Pavel, Fundamentals of Pattern Recognition: Second Edition (1993) 

175. S. A. Albeverio et a!., Noncommutative Distributions (1993) 

176. W. Fulks, Complex Variables (1993) 

177. M. M. Rao, Conditional Measures and Applications (1993) 

178. A. Janicki and A. Weron, Simulation and Chaotic Behavior of a-Stable Stochastic 
Processes (1994) 

179. P. Neittaanmaki and D. Tiba, Optimal Control of Nonlinear Parabolic Systems (1994) 

180. J. Cronin, Differential Equations: Introduction and Qualitative Theory, Second Edition 
(1994) 

181. S. Heikkila and V. Lakshmikantham, Monotone Iterative Techniques for Discontinuous 
Nonlinear Differential Equations (1994) 

182. X. Mao, Exponential Stability of Stochastic Differential Equations (1994) 

183. B. S. Thomson, Symmetric Properties of Real Functions (1994) 

184. J. E. Rubio, Optimization and Nonstandard Analysis (1994) 

185. J. L. Bueso et al., Compatibility, Stability, and Sheaves (1995) 

186. A. N. Michel and K. Wang, Qualitative Theory of Dynamical Systems (1995) 

187. M. R. Darnel, Theory of Lattice-Ordered Groups (1995) 

188. Z. Naniewicz and P. D. Panagiotopoulos, Mathematical Theory of Flemivariational 
Inequalities and Applications (1995) 

189. L. J. Co rwin and R. H. Szczarba, Calculus in Vector Spaces: Second Edition (1995) 

190. L H. Erbe etal.. Oscillation Theory for Functional Differential Equations (1995) 

191. S. Agaian et al.. Binary Polynomial Transforms and Nonlinear Digital Filters (1995) 

192. M. I. Gil’, Norm Estimations for Operation-Valued Functions and Applications (1995) 

193. P. A. Grillet, Semigroups: An Introduction to the Structure Theory (1995) 

194. S. Kichenassamy, Nonlinear Wave Equations (1996) 

195. V. F. Krotov, Global Methods in Optimal Control Theory (1996) 

196. K. I. Beidaret al.. Rings with Generalized Identities (1996) 

197. V. I. Amautov et al., Introduction to the Theory of Topological Rings and Modules 
(1996) 

198. G. Sierksma, Linear and Integer Programming (1996) 

199. R. Lasser, Introduction to Fourier Series (1996) 

200. V. Sima, Algorithms for Linear-Quadratic Optimization (1996) 

201. D. Redmond, Number Theory (1996) 

202. J. K. Beem et al., Global Lorentzian Geometry: Second Edition (1996) 

203. M. Fontana et al., Prtifer Domains (1997) 

204. H. Tanabe, Functional Analytic Methods for Partial Differential Equations (1997) 

205. C. Q. Zhang, Integer Flows and Cycle Covers of Graphs (1997) 

206. E. Spiegel and C. J. O’Donne//, Incidence Algebras (1997) 

207. B. Jakubczyk and W. Respondek, Geometry of Feedback and Optimal Control (1998) 

208. T. W. Haynes et al.. Fundamentals of Domination in Graphs (1998) 

209. T. W. Haynes et al.. Domination in Graphs: Advanced Topics (1998) 

210. L A. DAIotto et al., A Unified Signal Algebra Approach to Two-Dimensional Parallel 
Digital Signal Processing (1998) 

211. F. Halter-Koch, Ideal Systems (1998) 

212. N. K. Gov// et al., Approximation Theory (1998) 

213. R. Cross, Multivalued Linear Operators (1998) 

214. A. A. Martynyuk, Stability by Liapunov’s Matrix Function Method with Applications 
(1998) 

215. A. Favini and A. Yagi, Degenerate Differential Equations in Banach Spaces (1999) 

216. A. Wanes and S. Nadler, Jr., Flyperspaces: Fundamentals and Recent Advances 
(1999) 

217. G. Kato and D. Struppa, Fundamentals of Algebraic Microlocal Analysis (1999) 

218. G. X.-Z. Yuan, KKM Theory and Applications in Nonlinear Analysis (1999) 

219. D. Motreanu and N. H. Pavel, Tangency, Flow Invariance for Differential Equations, 
and Optimization Problems (1999) 

220. K. Hrbacek and T. Jech, Introduction to Set Theory, Third Edition (1999) 

221. G. E. Kolosov, Optimal Design of Control Systems (1999) 

222. N. L. Johnson, Subplane Covered Nets (2000) 

223. B. Fine and G. Rosenberger, Algebraic Generalizations of Discrete Groups (1999) 

224. M. Vath, Volterra and Integral Equations of Vector Functions (2000) 

225. S. S. Miller and P. T. Mocanu, Differential Subordinations (2000) 



226. R. Li et a!., Generalized Difference Methods for Differential Equations: Numerical 
Analysis of Finite Volume Methods (2000) 

227. H. Li and F. Van Oystaeyen, A Primer of Algebraic Geometry (2000) 

228. R. P. Agarwal, Difference Equations and Inequalities: Theory, Methods, and Applica¬ 
tions, Second Edition (2000) 

229. A. B. Kharazishvili, Strange Functions in Real Analysis (2000) 

230. J. M. Appell et al.. Partial Integral Operators and Integra-Differential Equations (2000) 

231. A. I. Pnlepko et al., Methods for Solving Inverse Problems in Mathematical Physics 
( 2000 ) 

232. F. Van Oystaeyen, Algebraic Geometry for Associative Algebras (2000) 

233. D. L. Jagerman, Difference Equations with Applications to Queues (2000) 

234. D. R. Hankerson et al.. Coding Theory and Cryptography: The Essentials, Second 
Edition, Revised and Expanded (2000) 

235. S. Dascalescu et al., Hopf Algebras: An Introduction (2001) 

236. R. Hagen et al., C*-Algebras and Numerical Analysis (2001) 

237. Y. Talpaert, Differential Geometry: With Applications to Mechanics and Physics (2001) 

238. R. H. Villaneal, Monomial Algebras (2001) 

239. A. N. Michel et al., Qualitative Theory of Dynamical Systems, Second Edition (2001) 

240. A. A. Samarskii, The Theory of Difference Schemes (2001) 


Additional Volumes in Preparation 




Preface 


In the early 1960s, when computers first became freely available to academic 
scientists, they spawned a whole new area of mathematics. Suddenly, for 
example, the solution of a system of 30 linear equations in 30 unknowns 
reduced to a problem that could be solved in a straightforward fashion on a 
computer using Gaussian elimination. A whole host of other applications, 
whose computational efforts were previously prohibitive, became feasible 
with the new technology. In addition, the availability of the technology 
itself spurred mathematicians to invent new methods of solution for existing 
and emerging problems. As we begin the first decade of this century, the 
exploitation of computers in mathematics has become very diverse. Some 
researchers use “blackbox” library routines to solve problems arising from 
physical situations. Others are engaged in developing software for such 
routines. Yet others are carrying out fundamental research in the capacities 
of existing methods and the design of new ones. But perhaps the best 
evidence of the effect the computer has had on mathematics in recent years 
can be seen in the undergraduate curriculum. Most university degrees 
in mathematics would now be regarded as incomplete without courses in 
discrete mathematics and numerical analysis - both subjects that have 
come to prominence because of modern computer technology. 

A rough description of the term modeling is the process of applying 
methods well-developed in computational mathematics to real-life situa- 

iii 
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tions. Quite often, the interest in modeling centers as much on getting 
an appropriate mathematical description of the problem as it does on the 
computational methods employed. Nevertheless there is a fruitful interplay 
between modeling and computational mathematics, as will be evident from 
a perusal of the first few chapters of this book. 

One can now say that a new method arose for theoretical investiga¬ 
tions of rather general and complex processes which allow for mathematical 
descriptions or mathematical modeling. This is the method of numerical 
experiment, which makes it possible better to understand real-world phe¬ 
nomena using exploratory devices of computational mathematics. When 
investigating some physical process by means of this method, an early step 
is the mathematical statement of a problem or the well-founded choice of 
a mathematical model capable of describing this process. It is preceded by 
a proper choice of physical approximations, that is, to decide which factors 
should be taken into account and which may be neglected or omitted in a 
general setting. This choice is the privilege of physicists. 

What is a mathematical model? The group of unknown physical quan¬ 
tities which interest us and the group of available data are closely intercon¬ 
nected. This link may be embodied in algebraic or differential equations. A 
proper choice of the mathematical model facilitates solving these equations 
and providing the subsidiary information on the coefficients of equations as 
well as on the initial and boundary data. 

Mathematical physics deals with a variety of mathematical models 
arising in physics. Equations of mathematical physics are mainly partial 
differential equations, integral, and integro-differential equations. Usually 
these equations reflect the conservation laws of the basic physical quantities 
(energy, angular momentum, mass, etc.) and, as a rule, turn out to be 
nonlinear. 

After writing a system of equations capable of describing the physical 
process of interest, it is necessary for the investigator to consider the 
resulting mathematical model by methods of the general theory of differ¬ 
ential and integral equations and to make sure that a problem has been 
completely posed and the available data are sufficient and consistent, to 
derive the conditions under which the problem has a unique solution, to 
find out whether this solution may be written in explicit form, and whether 
particular solutions are possible. Particular solutions are important in giv¬ 
ing the preliminaries regarding the nature of the physical process. They 
also can serve as “goodness-of-fit” tests for the desired quality of numerical 
methods. At the second stage, one is to construct an approximate (numer¬ 
ical) method and a computer algorithm for solving the problem. The third 
stage is computer programming of the algorithm under such a choice. At 
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the fourth stage the computational procedures need to be investigated and 
implemented. The fifth stage focuses on the review of their delivery and 
necessary corrections to the approved mathematical model governing what 
can happen. 

It may turn out that the mathematical model is too rough, meaning 
numerical results of computations are not consistent with physical exper¬ 
iments, or the model is extremely cumbersome for everyday use and its 
solution can be obtained with a prescribed accuracy on the basis of sim¬ 
pler models. Then the same work should be started all over again and the. 
remaining stages should be repeated once again. 

The stages of numerical experiments for theoretical investigations of 
physical problems were explained above. Greatest attention is being paid 
to a new technology for research with rather complicated mathematical 
models. 

Classical methods of mathematical physics are employed at the first 
stage. Numerous physical problems lead to mathematical models having 
no advanced methods for solving them. Quite often in practice, the user is 
forced to solve such nonlinear problems of mathematical physics for which 
even the theorems of existence and uniqueness have not yet been proven 
and some relevant issues are still open. 

For the moment, we are interested only in the second stage of nu¬ 
merical experiments. A computational algorithm usually means a sequence 
of logic and arithmetic operations that enables us to solve a problem. A 
computational algorithm is developed to solve the problem with any degree 
of accuracy s > 0 in a finite number of operations Q(e). This is the gen¬ 
eral requirement, thus raising many mathematical questions. What does 
the expression “with any degree of accuracy” mean? A possibility, at least 
in principle, of obtaining a. solution with a prescribed accuracy should be 
substantiated. However, sometimes it may happen that Q(e) is finite for 
some e, but it is so great that in practice it is unrealistic to produce a so¬ 
lution with such a degree of accuracy. For any problem an infinite number 
of various computational algorithms may be constructed possessing, for ex¬ 
ample, similar asymptotic properties, so that Q(s) will be of the same order 
in e as e —> 0. Not all such methods should be involved, but only those 
suitable for computational restrictions. Naturally, the methods should be 
used that require the minimal execution time for solving the problem with 
a prescribed accuracy. The execution time must be reasonable, that is, 
measurable in minutes or hours if such calculations are encountered very 
rarely. Of course, the computing process must be as inexpensive as possible. 
The time for solving the problem depends on the algorithms, quality of the 
program and computer performance. It is difficult to evaluate the latter 
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when only a priori estimates of the algorithm quality are available. The 
same applies equally well to the total number of logic operations regardless 
of how computers will be chosen. Therefore, in theoretical investigations it 
is fairly common to compare computer algorithms by means of the number 
of arithmetic operations Qo(e)- An economical algorithm having the mini¬ 
mal number of operations is sought in the class of possible algorithms (for 
instance, with the same asymptotics for Qo(e) as £ —0). This is one of 
the main problems in the theory of numerical methods. 

At the initial stage of such an analysis of algorithms it is usually sup¬ 
posed that a computing process is ideal, that is, computations are carried 
out with an infinite number of significant digits. But any computer makes 
calculations with a finite speed and a finite number of digits. Not all num¬ 
bers are accessible to computers; there are computer null and computer 
infinity. For instance, abnormal termination occurs when computer infinity 
arises during the course of execution. A computing process may become 
unstable, thus causing difficulties. In such cases rounding errors may ac¬ 
cumulate to a considerable extent so that the algorithm will be useless in 
practical applications (several examples of unstable algorithms are avail¬ 
able in Chapter 2). A real, that is, a, proper computer algorithm should 
be stable and should not allow excessively large intermediate values lead¬ 
ing to abnormal termination. From such reasoning it seems clear that an 
ideal computer algorithm may be optimal with respect to the number Qo(e) 
and quite unfit for computers. These requirements necessitate seeking an 
optimal real computer algorithm. 

Any numerical experiment is not a one-time calculation by standard 
formulas. First and foremost, it is the computation of a number of possi¬ 
bilities for various mathematical models. For instance, it is required to find 
the optimal conditions for a chemical process, that is, the conditions under 
which the reaction is completed most rapidly. A solution of this problem 
depends on a number of parameters (for instance, temperature, pressure, 
composition of the reacting mixture, etc.). In order to find the optimal 
workable conditions, it is necessary to carry out computations for different 
values of those parameters, thereby exhausting all possibilities. Of course, 
some situations exist in which an algorithm is to be used only several times 
or even once. 

The statement of the problem of finding an optimal algorithm depends 
on how it is to be applied (for individual variants or a great number of 
variants). 

Here various issues surrounding programming, organization and re¬ 
alization of computing are of little interest and will be excluded from 
further consideration. It is worth noting, however, that programming 
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should be closely linked with further development of numerical algorihms. 
Mathematical-physics problems are fairly complicated and algorithms for 
solving them are extremely cumbersome. In mastering the difficulties in¬ 
volved, one might reasonably try to split them into blocks or “modules”. 
Fortunately, quite often processes having different physical backgrounds 
will be described by the same equations (for instance, the processes of 
diffusion, heat conduction, and magnetization). One and the same mathe¬ 
matical model could be suitable for various physical problems even if each 
one has its own physical particulars. On the other hand, a mathematical 
model may change substantially a number of times during the course of 
numerical experiments and this obstacle necessitates improving the algo¬ 
rithm constructed and the corresponding program. Therefore, it becomes 
extremely important to create programs (a program package) in conformity 
with the modulus principle, whose use permits us efficiently to conduct nu¬ 
merical experiments and solve various types of problems of miscellaneous 
physical genesis. This is one, of the modern trends in programming and 
solving major mathematical-physics problems leading to the development 
of new numerical methods. 

Usually the finite difference method or the grid method is aimed at 
numerical solution of various problems in mathematical physics. Under 
such an approach the solution of partial differential equations amounts to 
solving systems of algebraic equations. 

This book is devoted to the theory of difference methods (schemes) 
applied to typical problems in mathematical physics. There seem to be at 
least two widespread approaches within the theory: 

(1) Composition of discrete (difference) approximations to equations of 
mathematical physics and verifying a priori quality characteristics of these 
approximations, mainly the error of approximation, stability, convergence, 
and accuracy of the difference schemes obtained; 

(2) Solution of difference equations by direct or iterative methods 
selected on the basis of the economy criteria for the corresponding compu¬ 
tational algorithms. 

Because of the enormous range of difference approximations to an 
equation having similar asymptotic properties with respect to a grid step 
(the same order of accuracy or the number of necessary operations), their 
numerical realizations resulted in the appearance of different schemes for 
solving the basic problems in mathematical physics. 

Of course, one strives to develop the best possible method, whose 
use permits us to obtain the desired solution in minimal computing time. 
Indeed, the search for such numerical procedures among admissible meth¬ 
ods is the main goal of such theory. In designing an optimal method (its 
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choice depends on the type of problems being solved) the set of admissi¬ 
ble methods is gradually reduced by successive introduction of necessary 
constraints and requirements regarding approximation, stability, economy, 
convergence, etc. The following general principle plays a crucial role in such 
matters: a difference scheme (a. discrete scheme) must reproduce properties 
of the initial differential equation as well as possible. 

In practical implementations, in order to construct difference schemes 
of a desired quality one should formulate the general approaches, heuristic 
tricks, turns, and rules for later use. The design of any method for solv¬ 
ing a problem is stipulated by the homogeneity and conservatism of the 
appropriate difference scheme. The meaning of conservatism is that the 
difference scheme reproduces some conservation law (a balance equation) 
on a grid. Conservatism of homogeneous schemes is a necessary condition 
for convergence in the class of discontinuous coefficients for stationary and 
nonstationary problems in mathematical physics. 

The property of the difference scheme conservatism for linear equa¬ 
tions is generally equivalent to the self-adjointness of the relevant difference 
operator (see Chapters 3-4). 

The basic notions of the theory of difference schemes are the error of 
approximation, stability, convergence, and accuracy of difference scheme. 
A more detailed exposition of these concepts will appear in Chapter 2. They 
are illustrated by considering a number of difference schemes for ordinary 
differential equations. In the same chapter we also outline the approach 
to the general formulations without regard to the particular form of the 
difference operator. 

The question of the accuracy of the scheme, being of principal impor¬ 
tance in the theory, amounts to studying the error of approximation and 
stability of the scheme. Stability analysis necessitates imposing a priori es¬ 
timates for the difference problem solution in light of available input data. 
This is a problem in itself and needs investigation. 

On the other hand, neither is the estimation of the approximation er¬ 
ror a trivial issue. Even the simplest example of the scheme on a nonequidis- 
tant grid for a second-order equation shows that it is desirable to evaluate 
the approximation error not in the C'-norm, but in a weaker norm of spe¬ 
cial type (in one of the negative norms), thus imposing the need for a priori 
estimates for a solution of a difference problem from the right-hand side 
in a weaker norm. Various estimates of this sort arising in Chapter 3 ap¬ 
ply equally well to establishing the convergence of homogeneous difference 

schemes in the case of discontinuous coefficients. 

This book includes many remarkable examples illustrating different 

approaches to the stability analysis of difference scheme. Thus, in Chapter 
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5 which is devoted to difference schemes for nonstationary equations with 
constant coefficients we discover asymptotic stability of difference schemes 
for the heat conduction equation, a property intrinsic to the differential 
equation. 

Chapters 2-5 are concerned with concrete difference schemes for equa.- 
tions of elliptic, parabolic, and hyperbolic types. Chapter 3 focuses on ho¬ 
mogeneous difference schemes for ordinary differential equations, by means 
of which we try to solve the canonical problem of the theory of difference 
schemes in which a. primary family of difference schemes is specified (in such 
a case the availability of the family is provided by pattern functionals) and 
schemes of a desired quality should be selected within the primary family. 
This problem is solved in Chapter 3 using a particular form of the scheme 
and its solution leads us to conservative homogeneous schemes. 

Chapter 4 provides the general theory of difference schemes in which 
it seems reasonable to eliminate constraints on the structure and implicit 
forms of difference operators. Such a theory treats difference schemes as 
operator equations (an analog of grid approximations for elliptic and in¬ 
tegral equations) and operator-difference equations (difference equations 
in t with operator coefficients), which are analogs of difference schemes 
for time-dependent equations of mathematical physics (for instance, equa¬ 
tions of parabolic and hyperbolic types). The operators of schemes are 
viewed in such a setting as linear operators in an abstract normed vector 
space Hh depending on the vector parameter h (an analog of a grid step 
in x = (xq, x 2 , . . . , x p )) equipped with the norm | h \ > 0. Thus, in the 
sequel two types of schemes will be given special investigation. 

The operator scheme is associated with an operator equation of the 
first kind 

Ay = f, 

which can always be parametrized by a real variable h, where A = Ah, 
A/,. Hh i—► Hh (the operator Ah depending on h really acts from Hh into 
Hh), f = f/, £ Hh is a known vector and y = y k £ Hh is the vector of 
unknowns. 

The two-layer operator-difference scheme we are interested in acquires 
the canonical form 

o / 3 “t 1 — y j 

B -1- Ay J =tp J , j~ 0,1,..., y°&H h , 

T 

where r is the step in t: tj = jr t j = 0,1,...; A, B: Hh Hh are 
operators depending on h and r and, generally, on ty, y 3 = y h T (tj) £ Hh 
and g> J = <p h (tj) £ H/ 7 are, respectively, the sought and given functions 
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of the discrete argument tj = jr with the values in the space H/, (below 
we omit the subscripts h and r). 

Multilayer schemes, that is, the schemes containing the values y(t) at 
some moments t = tj, tj +l , tj +2 , .. . may be reduced to two-layer schemes, 
where A and B are operator matrices. 

Stability theory is the central part of the theory of difference schemes. 
Recent years have seen a great number of papers dedicated to investigat¬ 
ing stability of such schemes. Many works are based on applications of 
spectral methods and include ineffective results given certain restrictions 
on the structure of difference operators. For schemes with non-self-adjoint 
operators the spectral theory guides only the choice of necessary stability 
conditions, but sufficient conditions and a priori estimates are of no less 
importance. An energy approach connected with the above definitions of 
the scheme permits one to carry out an exhaustive stability analysis for 
operators in a. prescribed Hilbert space Hj,. 

Clearly, stability is an intrinsic property of schemes regardless of ap¬ 
proximations and interrelations between the resulting schemes and relevant 
differential equations. Because of this, any stability condition should be 
imposed as the relationship between the operators A and B. More specifi¬ 
cally, let a family of schemes specified by the restrictions on the operators 
A and B be given: A = A* > 0 or (Ay, v) = (y, Av) and (Ay, y) > 0 for 
any y, v £ H, where ( , ) is an inner product in H, B > 0 and B yf B* 
(B is non-self-adjoint). The problem statement consists of extracting from 
that family a set of schemes that are stable with respect to the initial data, 
having the form 

yj +1 — yj 

B- --— V Ay 3 = 0 , j = 0,l,..., y°eH h , 

T 

and satisfying the inequality 

\\y j \\ A < IIy° \\ A > \\y\\ A = \/(Ay7y)- 

The meaning of stability here is the validity of the preceding estimate. 

A necessary and sufficient condition for a two-layer scheme to be stable 
can be written as the operator inequality 

B > 0.5 r A 


or 

(By, y) > 0.5 T (Ay, y) for any y £ H . 
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This condition can easily be verified in the case of discrete schemes for 
equations of mathematical physics. It allows one to extract from the pri¬ 
mary family of schemes the set of stable schemes, within which one should 
look for schemes with a prescribed accuracy, volume of computations, and 
other desirable properties and parameters. 

One of the important corollaries to stability theory is the general 
method of regularization in the class of stable schemes (by changing the 
operators A and B ) for the design of schemes of a desired quality. 

Chapter 6 includes a priori estimates expressing stability of two-layer 
and three-layer schemes in terms of the initial data and the right-hand side 
of the corresponding equations. It is worth noting here that relevant ele¬ 
ments of functional analysis and linear algebra, such as the operator norm, 
self-adjoint operator, operator inequality, and others are much involved in 
the theory of difference schemes. For the reader’s convenience the necessary 
prerequisities for reading the book are available in Chapters 1-2. 

The book includes many good examples illustrating the practical use of 
general stability theory with regard to particular schemes to assist the users 
in subsequent implementations. Stability is probably the most pressing 
problem in any algorithm, since it is a necessary rather than a sufficient 
condition for accuracy. 

Despite the great generality of the research presented in this book, it 
is of a constructive nature and gives the reader an understanding of relevant 
special cases as well as providing one with insight into the general theory. 
I hope it proves to be useful and stimulating. 

One of the popular branches of modern mathematics is the theory of 
difference schemes for the numerical solution of the differential equations 
of mathematical physics. Difference schemes are also widely used in the 
general theory of differential equations as an apparatus available for proving 
existence theorems and investigating the differential properties of solutions. 

The theory of difference schemes has a number of special problems. 

In the final analysis, of greatest importance from the viewpoint of 
numerical analysis is the design of algorithms permitting one to obtain a 
solution of a differential equation on a computer with a prescribed accuracy 
in a finite number of operations. The user can encounter in this connection 
the question of the quality of an algorithm, that is, the manner in which 
the accuracy of the algorithm depends on 

1) the available information on the original problem, 

2) the amount of calculation (viz. the machine time spent in solving 
the problem with a prescribed accuracy). 

Experience with computers has stimulated the formulation of a number of 
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special (for the theory of difference methods) problems: 

1) the determination of the attainable order of accuracy of difference 
schemes for various classes of problems, 

2) the design of schemes for the solution of a wide class of problems 
with a certain guaranteed accuracy, 

3) the construction of schemes with increased accuracy in narrower 
classes of problems, 

4) the development of methods for investigating stability and conver¬ 
gence of difference schemes, 

5) the formulation of the general principles for constructing stable dif¬ 
ference schemes and economizing the amount of calculation (eco¬ 
nomical schemes) 

and others. 

The main purpose of the final chapters is to show how the results 
of the general theory of difference schemes are aimed at stating principles 
for constructing difference schemes of a prescribed quality. This approach 
requires forsaking a more detailed description of the structure of difference 
operators for concrete classes of differential equations and presenting the 
theory in the language of functional analysis. The difference schemes re¬ 
lating to analogs of nonstationary equations of mathematical physics are 
treated in this connection as difference (with respect to the variable t) equa¬ 
tions with operator coefficients in an abstract space of any dimension. The 
difference schemes for elliptic equations are viewed as operator equations of 
the first kind. It should be emphasized, however, that the indicated notions 
of schemes have a much more general meaning. 

Stability theory is quite applicable to formulate a general principle 
for regularizing difference schemes in order to obtain stable schemes of a 
prescribed quality. 

The theory of iterative methods for solving the equation Au = /, 
where A £ (H i—► H) is a linear operator in a Hilbert space H , is treated as 
a contemporary part of the general stability theory of operator-difference 
schemes. Our main concern is with obtaining effective estimates for the 
rate of convergence of the iterations and with choosing an optimal set of 
iteration parameters. Special attention is being paid to a class of im¬ 
plicit schemes with a factorized operator B on the upper level of the form 
B = (E + ojRi) (E + U 1 R 2 ), where E is the identity operator, w > 0 is 
a numerical parameter, and R\ and R 2 = R\ are adjoint or “triangular” 
(with a triangular matrix) linear operators. A formula for the parameter to 
is obtained through such an analysis from the condition that the number 
of iterations be minimized. 
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An estimate of the convergence rate for the method of minimal cor¬ 
rections is derived in the case when A is a non-self-adjoint operator and in 
others situations. 

Also, we consider the total approximation method as a constructive 
method for creating economical difference schemes for the multidimensional 
equations of mathematical physics. The notion of additive scheme is intro¬ 
duced as a system of operator difference equations that approximates the 
original differential equation in the total sense. Two quite general heuristic 
methods (proposed earlier by the author) for obtaining additive economical 
schemes' are discussed in full details. The additive schemes require a new 
technique for investigating convergence and a new type of a priori estimates 
that take into account the definition of the property of approximation. 

We have not had the chance to discuss some works on difference meth¬ 
ods of an applied character, although such works best illustrate the real pos¬ 
sibilities of difference methods and provide constant sources of stimulation 
for the formulation of new problems. 

When economical schemes for multidimensional problems in mathe¬ 
matical physics are developed in Chapter 9, we shall need a revised concept 
of approximation error, thereby changing the definition of scheme. The 
notion of summed (in t) approximation in Section 3 of Chapter 9 is of a 
constructive nature, making it possible to produce economical schemes for 
various problems. 

Last, but not least, I wish to thank those who have assisted me in 
this enterprise. 


Alexander Samarskii 
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Preliminaries 


Contemporary methods for solving problems of mathematical physics are 
gaining increasing popularity. They are being used more and more in solv¬ 
ing applied problems not only by professional mathematicians, but also by 
investigators and users working in other branches of science, engineering 
and technology. In order to make this book accessible not only to special¬ 
ists, but also to graduate and post-graduate students, we give a complete 
account of notions and definitions which will be used in the sequel. The 
concepts and theorems presented below are of an auxiliary nature and are 
included for references rather than for primary study. For this reason the 
majority of statements are quoted without proofs. We will also cite biblio¬ 
graphical sources for further, more detailed, information. 


1.1 DIFFERENCE EQUATIONS 

1. Preliminary comments. By applying approximate methods the problem 
of solving differential equations leads to the systems of linear algebraic 
equations: 

A u = f 

where A = ( cm) is a square (N x vV)-matrix, u is the vector of unknowns 
and f is the right-hand side vector. 


1 
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Most of the well-developed methods available for solving such a system 
falls within the categories of direct or “exact-fitted” methods and iterative 
or successive-approximate methods which are gaining increasing popularity. 

The starting point in more a detailed exploration is the simplest sys¬ 
tems of linear algebraic equations, namely, difference equations with special 
matrices in simplified form, for example, with tridiagonal matrices. 

The history of difference equations contains plenty of good examples 
when such equations emerged during the course of direct descriptions of real 
processes in science and technology. Equations of mathematical physics, 
that is, partial differential equations are sources for a broad class of differ¬ 
ence equations approximating integral and differential equations and give a 
substantial contribution to the continuing development of the theory of dif¬ 
ference schemes. The main feature of difference equations is stipulated by 
the fact that the matrices of the high-order corresponding systems (about 
10 4 -10 5 ) are sparse. 

It is natural from the viewpoint of applications to treat various dif¬ 
ference equations regardless of the initial differential equations which have 
induced them. All of the resulting schemes and properties are invariant to 
a concrete differential equation. 

In the present section a direct method for solving the boundary-value 
problems associated with second-order difference equations will be the sub¬ 
ject of special investigations, 

2. Examples of difference equations. Undoubtedly, the reader has already 
encountered the simplest examples of first-order difference equations in con¬ 
nection with the formulae for the terms of an arithmetic or a geometric 
progressions: a k+ i = a k + d or a k+ 1 -2 a k + a k _ i = 0 and a k+ i = qa k , 
respectively, where the argument of the members a k = a(k) takes only 
positive integer values. 

We briefly touch upon the basic concepts of the grid methods. The 
basic notions such as grids and grid functions will be studied in more de¬ 
tail in Chapter 2. A discrete set of points (nodes) is called a grid or 
lattice. Let a grid function yi — y(i) of the integer-valued argument 
i = 0, ±1, ±2, ., ., be given. The right and left differences are defined 
at a point i to be: 


A yi y(i + 1) - y{i) = yi+i - yi , 
Vy; ~ y{i) - y{i - 1) = Vi - j/i-i • 


By definition, Ai/i_i = yi — y 8 -_i = Vj/j. It should be noted that the 
expressions above may be viewed as formal analogs of the first derivative 
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Lu = u! known from differential calculus. The same procedure works for 
the second, the third and other differences 

A 2 yi = A (Ay,) = A (y i+l - y 8 ) 

— (Vi+ 2 — Vi + l) ~ (Di + 1 ~ Vi) = Di + 2 ~ ^ Vi + 1 + Vi , 


A m y i = A(A m - 1 y i ). 

We see that one more right point is captured every time when the operator 
A is applied. Consequently, applying A for m times we justify that A m y 8 
contains the values yi , y 8+i , . . . , y; +m at the points i,i + 1, ... , i + m. 

A very simple rule could be useful: the left difference operation at any 
point i coincides with the right difference operation at the point i — 1 so 
that 

AV iji = A 2 y 8 _j. = y i+l - 2 y t - + y 8 _i . 

Let a linear equation with the entering differences and coefficients 
a 0 (i), (i), . . . , a m (i) be composed: 

«„(*) Vi + a i(*) 1 Vi + ■ ■ ■ + A y,; + a m {i) yi = /; . 

Substituting the expressions for differences A k yi, k = 1,2,... , m, one can 
modify it to an mth order linear difference equation related to an 
unknown y 8 : 


^0 (0 Vi+rn 1 ''' ^rn— 1 (0 Vi-{-l “f Q’m(l') di — ) 

^o(0 ~f~ ^ ^ 0 . 

This definition is a formal analog of an mth order ordinary differential 
equation 


/ N d m u / . d m ~ l u 

a n(x) --ha, (a:) -- r 

J cl x m u ' dr" 1 " 1 


+ a m _i(x-) ^ + a m (x) ti = /(x) 




As one possible example we consider the simplest ordinary differential equa¬ 
tion 


du 

dx 


f ( x ) 
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and offer below some of its approximations with new notations Uj = u[x,), 
w i+1 = w(a!j- + i) and 1 = x, + h, where h > 0 is the distance from x, to 
Xi + h, namely 


du 

dx 


i(xi + h) — u(x{) _ m+i — Ui 


A’, 


( 

or 

( 

All of the preceding difference expressions approach as h —> 0. The 
symbol ~ means, as usual, approximation or correspondence. In what 
follows we say that the expression 


du 

ix 


Mi-1 


V Ui 
h 


du 

dx 


Mi + l Ui — 1 

2 h 


A i 


V Ui 


2 h 


A m _ u i+i - Uj 
h. h 

approximates the first derivative ^ = u'. 

The very definition implies that the equation 

= fi , fi = f( x i) . 

is a first-order difference equation in one or another form 

A iji - h fi or y i+i - jji + h fi . 

There is no difficulty to solve this equation for a given initial value y 0 . 
It should be noted here that a second-order difference equation also may 
appear in approximating a first-order differential equation, for example, in 
connection with these expressions 

M(*i + i) = u(xi) + h u'(xi) + \ h 2 u"(xi) + ^ /i 3 u'"(xj) + 0(h 4 ), 

u(x.i-i) = u(x'i) — h u'(xi ) + \ h 2 u"{xi) — | h 3 u"\xi) + 0(h 4 ) , 



Difference equations 


5 


the sum of which gives 


Ui +1 - 2 in + _ i 

h 2 


= < + 0(h 2 ) . 


Neglecting 0(h 2 ) we derive rough expressions for u" within the notations: 


cTw 

dx 2 


Ui + 1 - 2«,- + w s _i _ A 2 Uj_i 


AV Ui 


h 2 


/r 2 


Substituting the first expression into the expansion rq + i = tq + h u[ + 
| h 2 u'! + 0(h 3 ) instead of w", we deduce that 


( 1 ) 


^£ + 1 ^2 

h 


h u i+ 1 - 2 uj + Uj_i 

2 /i 2 


0(/r 2 ). 


Replacing in (1) by /,• we cancel 0(h 2 ) and multiply the resulting equa¬ 
tion by 2 h. As a final result we get the second-order difference equation 


AV yi-2Ayi = -2hfi. 


Its modification gives the approximation of the first-order differential equa¬ 
tion 

dy _ r 
dx 

Difference equations possess remarkable properties which will be given spe¬ 
cial investigation in the near future. 

3. The first-order difference equations and inequalities. Of our concern is 
the first-order difference equation 

(2) bAyi + a y, = /; , 

which is a formal analog of the first-order differential equation 

du 

b — + au =■ f. 
dt J 

Alternative forms of equation (2) are 

b (yi+i ~ Vi) + & Vi = fi or b y i+1 = cy t + fi, c=b-a. 
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In the general case b = b,, a = a, and c = Cj, that is, we deal with known 
functions of the argument i. If 6 , yf 0, then 

Di+i = ft y* + <Pi ■ 


It is evident that 

ft f* i / n 

ft = r > vft = r ’ ft ft 0 • 

ft hi 

Thus, we see that this problem has a unique solution if the value y is given 
for some i. For the sake of simplicity let y 0 be known in advance for i = 0. 
With this, one can determine all the values y 1 , y 2 , ... by the recurrence 
formula just established. In the case qi = q = const and q>i — 0 this 
provides support for the view that the whole collection of y* constitutes a 
geometric progression. If qi = q and <fli ^ 0, then 


Vi+i = qyi + <Pi = q (qyi-i +<Pi-i) + <Pi = q 2 yi-i + <pi + q<pi -1 • 


The outcome of this is 

(3) y i + 1 = q l+1 y 0 + ipi + qifii -1 + • • • + q l ~ X ip 1 + q l <p 0 

= q l+1 Vo + E • 

k = 0 

Adopting those ideas, it performs no difficulty to find a solution to the 
equation yj + i = q t yi + <p %, i — 0 , 1 , 2 , . . ., in the case qi ^ const. 

In tackling the first-order difference inequalities 

(4) y *+i < qyi + fi, i- 0 , 1 , 2 , ... , 

with known members q > 0 and jq and a given value y 0 we prefer an 
alternative form of writing 

(5) v i+1 = q Vi + ft , v 0 = y 0 . 

Its solution can be most readily found with further reference to the relation 
yi < Vi. Indeed, subtracting equality (5) from inequality (4) we get 

y i+ i - v i+1 < q (yi - Vi) < q 2 (y*_i - i) < • • • < q t+1 (y 0 - v 0 ) = 0 , 

yielding y, + i < i»j + i for any 5 , where V{ has been expressed in q, v 0 , fi by 
analogy with (3). 



Difference equations 


7 


4. The second-order difference equations. The Cauchy problem. Bounda¬ 
ry-value problems. The second-order difference equation transforms into 
a more transparent form 

( 6 ) A-i t)i-i C{ yi -f Bi — Fi , i — 1 , 2 ,..., 

Ai ^ 0 , Bi jz. 0 , 

which in the notation A = r/ i+ i — yi becomes is modified as follows 

(7) Bi A yi Ai A yi-\ (C i Bi Ai) yi — Fi . 

By virtue of the relations 


A yi - V yi = A y { - A y i - 1 = A 2 iji - A = y I+1 - 2 ?/* + _ r , 

A t/i-i = - A 2 j/i_ i + A y { , 


equation (7), in turn, can be rewritten as 

Ai A 2 y z -1 + (B 2 — Ajj- (Cj — A; — Bi) yi = —Fi , Ai ^ 0 , 
or, what amounts to the same, 

Bi A 2 yi -1 + (Bi - Ai) A y;_i - (C* - A, : - Bi) y t = -Fi. 


The latter difference equation clarifies that ( 6 ) is an analog of a second- 
order differential equation. 

It is necessary to specify two conditions for the complete posing of this 
or that problem. The assigned values of y and A y suit us perfectly and 
lie in the background a widespread classification which will be used in the 
sequel. When equation ( 6 ) is put together with the values yi and A yi given 
at one point, they are referred to as the Cauchy problem. Combination 
of two conditions at different nonneighboring points with equation ( 6 ) leads 
to a boundary-value problem. 

For the sake of definiteness, we concentrate primarily on Cauchy prob¬ 
lem with given y 0 and A y 0 . Knowing y 0 and y 1 = y 0 + A y 0 , iji for 
i = 2,3,... serves as a basis for the formulae 


Vi+i = 


C'z yi Ai yi~i Fi 

Bi 


Bi ^ 0 . 


Therefore, it is concluded that problem ( 6 ) has a unique solution for given 
value y 0 and y 1 . 
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For the second-order difference equations capable of describing the 
basic mathematical-physics problems, boundary-value problems with addi¬ 
tional conditions given at different points are more typical. For example, if 
we know the value y 0 for i — 0 and the value y N for i — N , the correspond¬ 
ing boundary-value problem can be formulated as follows: it is necessary 
to find the solution t/*, 0 < i < N, of problem ( 6 ) satisfying the boundary 
conditions 

(8) y 0 = . y N = 

with known numbers y 1 and y 2 . 

Common boundary conditions may be specified by 

(S') y 0 = f/i + , y N = x 2 y N _, + y 2 , 

that is, at the boundary nodes i — 0 and i — N not only the function values, 
but also the first difference values or linear combinations of the function 
and difference values are yet to be known. Substituting y x — y 0 + A y 0 into 
the first condition ( 8 ') yields 

(8") Xj A y 0 - (1 - y 0 = -y 1 

and needs certain clarification. The case x 1 = 0 corresponds to the first 
kind boundary condition: y 0 is given at the boundary node i = 0 . 
When Xj = 1 we deal with the second kind boundary condition: A y 0 
is given at the same node. All the cases with yf 0; 1 reflect the third 
kind boundary condition as a linear combination of the function and 
the first difference at the node i = 0 . 

Due to serious achievements of the Russian and foreign mathemati¬ 
cians in applied mathematics the majority of mathematical-physics prob¬ 
lems may be reduced to computational algorithms, at every step of which 
3-point equations like ( 6 ) with conditions ( 8 ') must be solved. 

Moreover, a lot of rather complicated problems in numerical analysis 
gives rise to the canonical problem, where a square (jV+ 1) x (N + l)-matrix 


of the corresponding system acquires 

a tridiagonal form 



/ 1 

— x 1 

0 

... 0 

0 

0 

0 

0 

0 \ 

A 

-Cj 

B, 

... 0 

0 

0 

0 

0 

0 

0 

0 

0 

... Ai 

-Ci 

B t 

0 

0 

0 

0 

0 

0 

... 0 

0 

0 

••• 4., - 

-C 

^ M — l 


V o 

0 

0 

... 0 

0 

0 

0 

-x 2 

1 / 
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In the case of boundary conditions of the second or third kinds its 
order is IV + 1, while for the system (6) with the supplementary conditions 

(8) the order is IV — 1. All the matrices of interest possess the main feature: 
they have nonzero elements only on the three diagonals (the main and two 
adjacent ones). 

With the aid of effective Gauss method for solving linear equations 
with such matrices a direct method known as the elimination method has 
been designed and unveils its potential in solving difference equations. 

5. The elimination method. The problem we must solve take now the form 

Ai yi _i - Ci yi + Bi y i+ 1 = -Fi , i = 1, 2, ... , N - 1; 

(9) 

Vo = *1 Vi + fT . y N = * 2 Vn-i + fT . 

where A{ yl 0 and B{ yl 0 for all i = 1,2, ... , N — 1. 

Other ideas are connected with reduction of the original second-order 
difference equation (9) to three first-order ones, which may be, generally 
speaking, nonlinear. First of all, the recurrence relation with indeterminate 
coefficients ay and /?* is supposed to be valid: 

( 10 ) yi = oy+r j/i+i + Pi +1 . 

Substituting ry_i = ay yi + Pi into (9) yields 

{Ai ai Of) yi -)- Ai Pi -1- Bi y;\ — G , 

which leads, because of (10), to 

[ {A t ai — Cp ai + 1 + Bi ] yi + i + Ai Pi + (Ai ai — Ci ) Pi+i — — Fi . 

If the conditions 

(Ai a-i — CP) au+i + Bi = 0 , A, Pi + (A, ai — Ci) Pi+i A Fi = 0 

are fulfilled simultaneously, then the equation in view holds true for any yi. 
Thus, assuming C) — ai Ai yf 0, we establish the recurrence formulae for 
determination of both ou + i and /G+i: 


(11) 

B t 

a z + l — r , . ) 

i= 1,2, .. 

■ , N- 1 

(12) 

a _ Ai Pi + Fi 

Pi + i “ * > 

Ci - oti Ai 

?:= 1 , 2 ,.. 

• , N- 1 
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under agreement (10). 

By going through the matter chronologically the forward elimination 
path for finding a,, Pi and the backward path for finding y,- do arise during 
the course of the elimination method. Let us clarify the situation. With 
knowledge of a, and /?; one can determine, according to (10), all the values 
Hi moving from i + 1 to i. To find cr* and /%, we succeed the reverse order 
(from i to i + 1) according to formulae (11)—(12). 

Two relevant aspects are worth noting in this context: 

1) equations (11)-(12) for finding ctj and Pi, being nonlinear, reproduce the 
relationships between the values at two adjacent points; 

2) for each unknown a, /? or y, it is necessary to solve the corresponding 
Cauchy problem. 

These requirements necessitate imposing auxiliary values which can 
serve as the initial conditions. The assignment of boundary conditions is 
aimed at specifying these or those values. Having substituted * = 0 into 
(10), we get y 0 = a 1 y 1 + P 1 . On the other hand, y 0 = x 1 y 1 + f.i 1 , giving 

(13) = Xj , 

(14) A=AO- 

Thus, we set up for a and /? the Cauchy problems described by (11), (13) 
and (12), (14), respectively, thereby completing the forward path of the 
elimination. 

At the second stage, knowing a, and Pi, the boundary value y N is 
recovered from the system of the equations 


\ V N = Vn -i + AO . 
I Vn -i a N Vn T Pn 


under the constraint 1 — a N x 2 yl 0. 

Hence, the initial condition in question becomes for (10) 

_ AO ~b Pn 
Vn — i 

l-a N x 2 

The computational formulae (10) and (15) constitute what is called the 
backward elimination path. 

The algorithm presented below as the sequence of applied formulae is 
called the right elimination method and is showing the gateway for the 
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general case: 


+ 

ii 

Bi 

* = 1,2,. 

..,N- 1, 

a i ~ 

Ci - cti Ai 

ii 

+ 

Ai Pi + Fi 

Ci - Ai 

* = 1 .2,. 

...N-l, 

Pi — ft 1 


_ 1*2 A -^2 Pn 
i-a N n 2 


V i — Q!j+i Vi+i + A+i ! i — N ~ l, N — 2,. . . , 1,0 . 

Here the symbols (—->) and (<—) indicate the directions of index count: either 
from i to i + 1 or from i + 1 to 

In connection with the preceding algorithm, it is natural to raise the 
question of correctness and stability providing a possibility of applying the 
method and obtaining a solution with a prescribed accuracy. Special inves¬ 
tigations give definite answers to to these questions. 

6 . Stability of the elimination method. Let us stress that the conditions 
Ci — cti Ai A 0 and 1 — a N x 2 ^ 0 cannot be excluded or relaxed during the 
course of the right elimination method. Just for this reason the restrictions 
on coefficients for well-posed and stability conditions needs investigation. 
Common practice involves sufficient conditions 


\C l \>\A l \ + \B l \ ) i = l,2,... ,N- 1 , 

(16) 

|x«|<l, a=l,2, |xj| + |x 2 | < 2 , 

yielding 1 \ai \ < 1 for all i = 1 , 2 ,. . . , N. 

The proof is carried out by induction. Assuming |a;| < 1 we will show 
that |ai+i| < 1. Since joyl = (xj < 1, the same propertry will cover all 
i = 2,3,... , IV on account the chain of the inequalities: 

\Ci-aiAi\-\Bi\ > IGI-M ■ \Ai \ — \Bi \ > \At\ ■ (1-H) >0, 


from which it follows that |C) — a, Ai \ > 0, since Bi A 0. 
Granted |cr s | < 1, observe that 


|«i+i 


\Bj\ 

| Q-Ai a t \ 


< 1 
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as well as |a;+i] < 1 are ensured by \on\ < 1. The assumption |aj] ~ \x 1 \ < 
1 implies \ai\ < 1 for all i — 1,2,... , n. The lower estimate holds true for 
the denominator in formula (15): 

I 1 - Tv ^2 I > 1 - ■ Kl > 1 - Kl > 0 , 

because either \x 2 j < 1 or |a N | < 1 . 

Thus, we have proved that under conditions (16) the right elimination 
algorithm is correct, meaning nonzero denominators in formulae ( 11 ), ( 12 ) 
and (15). So, under conditions (16) problem (9) has a unique solution given 
by formulae (10)—(15). 

It is necessary to point out that calculations by these formulae may 
induce accumulation of rounding errors arising in arithmetic operations. As 
a result we actually solve the same problem but with perturbed coefficients 
A,, Bi, Ci, Xj, x 2 and right parts Fi, y 1 ,Ji 2 . If N is sufficiently large, the 
growth of rounding errors may cause large deviations of the computational 
solution tji from the proper solution j/j. 

The trivial example shows how instability may arise in the process of 
calculations of y, by the formula y t - +i = qt/i, q > 1. One expects that, for 
any y 0 , there exists a number n 0 such that overflow occur for y n = q n y 0 , n = 
n 0 , thus causing a abnormal termination. An important obstacle in dealing 
with this problem is that y t - satisfies the equation i /; +1 — qy% + rj with a 
rounding error rj. Indeed, for the error S yi = i/i — yi the equation is valid: 

8y i+ i = qSyi+y, 8y 0 =r), 

from which it follows that the value 

q i — 1 

$ Vi - q l v +-r r i’ ? > i > 

q - 1 

increases exponentially along with increasing i. 

Returning to the right elimination method, we show that the condi¬ 
tions |a; | < 1 guarantee that the error 8yi+i = yi+i — ?/i+i arising when 
computing y,- does not increase. Indeed, the equations 

Vi — a i +1 Vi + l + Pi +1 ! Vi = a i +1 Vi +1 + Pi + i 

imply that 

6 yt = aj+i 8 i Ji+1 , |<5 yi | < \a i+ i | ■ |<5 y i+ i |, 

meaning |<5y;| < |(5yi+r| because |tti+i| < 1 . 

Taking into account perturbations of the coefficients a J+ i and fii+i, 
another conclusion can be drawn that the accuracy e in determination of 
the solution yi of problem (9) is 

max \8y t \ tn e 0 N 2 , 

1 <i<N 

where e 0 is a rounding error and N is the total number of grid nodes. 
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7. The left elimination method. The counter elimination method. Still 
using the framework of the right elimination method (formulae (10)—(15)) 
in reverse order, we obtain through such an analysis the computational 
formulae of the left elimination method: 


(17) 

H A 

* ' Q- 6+1 Bi ’ 

i = N - 

1,7V - 2,.. 

• , 2 , 1 , 

Zn = *2 

(18) 

W Bi rj i+ i + Fi 

Ci- & +1 Bi ’ 

i = N — 

1, TV — 2,. . 

• ,2,1, 

Vn = V 2 

(19) 

H 

y i -\-1 — £i + l Vi "h + l > 

i = 0,1, 

... ,7V- 1, 




and 

( 20 ) 


Vo 


7 d + Xj rq 
1 - 


Indeed, with the relation yi + rq + i granted we eliminate suc¬ 

cessively yi + 1 , yi = (, t yi -1 + rji from equation (9). The outcome of this 
is 


Fi — Ai yi— 1 T (- 77 j ‘Cz + l Vi T Bi 7]i -\-1 

— [ (C; Bi ] yi— i T Bi 17^_j_ 1 (C^ Bi ^-(-1) . 

Equation (9) is valid if we agree to consider 

Ai - (Ci - B{ £j + i) & = 0 , -Fi = Bi ry + i - (Ci - Bi &+i) ry , 

from which formulae (17) and (18) immediately follow. The value y 0 can 

be found from the condition y 0 = tq +y : and the formula tq = Tq jq +Vo- 
The presented inequalities 

• fe+i|, >1-1^1 • kl 

confirm that the correctness and stability of the left elimination method 
are ensured by conditions (16), since |^| < 1 for all i = 1, 2,. .. , TV. 

Joint use of the left and right elimination methods refers to the counter 
elimination method. The essence of this method is to consider a fixed inner 
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node i = i 0 , 0 < i 0 < TV, and to compute the coefficients a, and f3i for 
0 < i < *o + 1 according to formulae (10)—(15): 


a i +1 ~ 


Bi 

i — 1,2, ... , i 0 , 

a 1 = 

Ci 

Qfj A i 

0i + 1 — 

M 

+ Fi 

i = 1, 2, ... , i 0 , 

Pi = to 

Ci 

OLi Ai 


and for i 0 < i < N the coefficients and rji can be found by formulae 
(17)—(20): 


Bi 77 *+ i + Fi 
Ci 0 + ] Bi 


i = N - 1, TV -2, ... , i 0 , 


= 70 ■ 


The next step is to put the first solution of the form (10) together with the 
second one of the form (9) the node i = i 0 . The outcome of this is 


Vi 0 + l Vi '0 + 7 d~ 0i$-\-L j Vi 0 + L + 7 ViQ d~ 77 *q 1 , 


yielding 

_ Bi Q + i + «i 0 + i ?7i 0 + i 

Vi n i 

1 - a i 0 +1 77*0 + 1 

As far as 1 — cei 0 +1 7?i 0 + i > 0, this formula is meaningful because under 
conditions (16) at least one of the modules: either |ay 0 _|_jj or |? 7 ; 0 +i| is less 
than 1. With knowledge of j/j the remaining values j/* arise in the process 
of parallel calculations: for i < i 0 by formula ( 10 ) and for i > i 0 by formula 

( 19) - 

Of course, the counter elimination method could be especially effective 
in an attempt to determine y, merely at only one node i = i 0 . 

8. Maximum principle. To make our exposition more transparent, the case 
of interest is related to the first kind boundary-value problem with x 1 = 0 
and h 2 ~0: 


T [//? ] — -d , iji — i Ci yi T Bi y i+ i — Bi , 

i = 1, 2, ... , N - 1 , 7/ 0 = TO > y N =fh- 


( 21 ) 
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Theorem 1 (The maximum principle). Let the conditions 

(22) Ai > 0, Bi> 0, Di = Ci-Ai-Bi> 0 

be fulfilled for all i = 1,2,... , TV — 1 and the grid function yi, yi ^ const, 
satisfy at all the inner nodes i = 1,2,. .. , TV — 1 the condition £ [yi] > 0 
(or C[yi\ < 0). Then yi cannot take the maximal positive value (or the 
minimal negative value ) at the inner points, that is, for i = 1,2,... , TV — 1. 

Proof Given a grid function t/;, let £ [yi] > 0 for all i — \ ,2,... , N — \ 
and yi attain its maximum at one of the inner nodes i = i t , 0 < i t < TV, 
so that 

2/i* = max y t — M 0 > 0 . 

0<i<N 

As yi ^ const, there exists an inner point i 0 (may be, coincident with i *) 
such that yi = yi t = M 0 > 0 and at one of the adjacent points, say for 
i — i 0 — 1, we have yi 0 -i < M 0 . We may attempt £ [yi] in simplified form 

£ (lti\ = Bi (2/i+i - Vi) - M (Vi - 2/i-i) - (C* - Bi)yi , 

leaving us under conditions (22) s at the point i = i 0 with 

£■{ Vio ] = Bi 0 (Ui 0 + i — Vi 0 ) — Ai g ( yi 0 — 2/i 0 -i) — (Ci 0 — Ai 0 — B io ) yi Q 

< ~B io (y iQ - y l0+1 ) - A 1q (y iQ - 2/* 0 _!) < 0 

by virtue of the relations 

2 li 0 > Vi 0 +i , Vi 0 > 2/i 0 -i > A i 0 > 0 . Bi 0 > 0 . 

The result obtained is not consistent with the condition: £ [yi] > 0, valid 
for all i = 1,2,... , At — 1 including j = i 0 . Thus, we proved the first 
statement of the theorem. The second one can be established in a same 
way with further replacement of yi by —yi. 

Corollary 1 Under conditions (22) and 

£ [yi] < 0 , i ~ 1, 2, ... , At - 1 ; y 0 > 0, y N > 0 , 

the function yi is nonnegative: yi > 0 for all i = 0,1,... , At. The case 
£ [yi] > 0, y 0 < 0 and y N < 0 leads to yi < 0 for other subscripts i = 
1,2,... , At — 1. 

Indeed, let £ [yi] < 0 and yi < 0 at least at one point i = i t . Then yi 
should attain its minimal negative value at an inner point i = i 0 , 0 < i 0 < 
N. But this fact contradicts Theorem 1. 
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Corollary 2 Under conditions (22) the problem 

(23) C [yi] = 0 , i = 1, 2, . . . , TV - 1 ; y 0 = 0 , y N = 0 , 

has the unique solution y, = 0 , thereby justifyingg that problem ( 21 ) is 
uniquely solvable for any ingredients F ,, and p 2 . 

In fact, assuming that the solution yi of problem (23) becomes nonzero 
at least at one point i = i t we come to a contradiction with the maximum 
principle: if t/j, > 0 , then t/; attains its maximal positive value at some 
point i 0 , 0 < i 0 < N , violating with Theorem 1; the case < 0 may be 
viewed on the same footing. 

Theorem 2 (Comparison theorem). Let conditions (22) hold, yi be the 
solution of problem (21) and ip be the solution to the following problem: 

£[yi] = -Fi, * = 1,2,... ,7V - l; y 0 = Pi, y N -P 2 , 

with 

\Fi\<F, i = 1,2,. .. ,7V - 1 ; |/hl</h, \ih\<f l 2- 

Then the relations occur: 


\Vi \ < Vi , 7 = 0,1,... ,7V. 

Proof Due to Corollary 1 we have yi > 0 for 0 < i < TV, since C [7/j] = 
— Fi < 0 and y 0 > 0, y N > 0. Observe that the functions = 7/j — j/ 2 - 
and Vi = yi + yi satisfy equation (21) with the right parts Fi — V) > 0 and 
Fi + Fi > 0 , and boundary values u 0 = p 1 — p 1 > 0 , u N = p 2 — p 2 > 0 and 
v 0 = p 1 + > 0, v N = p 2 + p 2 > 0, respectively. By applying Corollary 1 

to such a setting we get > 0 , Vi > 0 or —yi < yi < yi, meaning |j/,-| < yi. 

The function 7/; is called a majorant for the solution of problem 
(21). A first step towards the solution of problem (21) is connected with a 
majorant yy || y c < \\y c . 

Corollary 3 The solution to the problem 

— 0) 0 < 7 < TV , Pq Pi } y n P 2 > 

can be majorized as 

II y c ■= M < max (ItcI. I/cl) • 
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The problem of auxiliary character such as 

£[k] = 0, 0 < i < N ; y 0 - y N = p = max (1/iJ, \y 2 \) , 

will complement our studiea, for which the comparison theorem gives || y c < 
\\y c - On the same grounds, Theorem 1 implies \\y c < p, since the function 
pi > 0 takes its maximal positive value only at a boundary point: either 
for i — 0 or for i = N. 


Theorem 3 Let the conditions 

(24) \Ai\ > 0, |fli|>0, Di = \Ci\-\Ai\- \Bi\ >0 

hold for all i — 1,2,... , TV — 1. A solution of the problem 

(25) £[yi] = -Fi, * = 1,2,... , N — 1 \ % = 0 , Vn = 0 > 

admits the estimate 

(26) II y c < 

To prove the desired estimate, the intention is to use an alternative 
form of equation ( 21 ) 

(27) Ci yi — Ai + Bi yi +l + Fi. 

Let \yi\ take its maximal value |t/;J > 0 at a point i = i 0 , 0 < i 0 < N , 
so that | y( | > \yi\ for all 7 = 0,1,... , At. We are led by equation (27) for 
i = i 0 to 


F 

15 


\Ci 0 Vi 0 1 = |Ci 0 | • | y io | = | A io r/i 0 - 1 + B io y iQ + l + F io \ 

< IA- 0 1 • |k 0 -i| + \Bi 0 1 • |k 0 +i| + |Tj' 0 | 

< (l^»ol + l^o I) ■ |y* 0 1 + l^oI • 


Because of this 


(Ia 0 |-|4: 0 MB I0 |) ' \Vi 0 \ = A 0 ■ k; 0 |<|^; 0 l 
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and, consequently, 


\Vi 0 I 


max 
0 <i<N 


\Vi \ < 



< 


F 

T) 


c 


Before going further, problem (25) with coefficients subject to condi¬ 
tions (22) for 0 < i < N may be of help in achieving the final aims: 


Ai > 0 , Bi > 0, Di = C t - Ai - Bi > 0. 


When the condition D{ > 0 fails to be true m arranges itself as a. sum 
0 0 
y i ■= y i -\- m , where y i solves 

(28) Bi {y i+1 - It) - A t {Vi - h-i) = -Fi , 0 < i < N , 

0 0 

y o = y N =0. 

The statement of the problem for iq is 

(29) L [«i] = Bi m+1 - Ci m + Ai Uj_i = -Di 2/ * , 0 < i < N , 

u 0 = u N - 0 . 

whose solution satisfies the inequality 

(30) \\u\\ c = \ Ut \ < \\°y\\ c . 


0 

This result is a corollary to the next lemma with fi — y i involved. 

Lemma. For the solution of problem (25) with coefficients subject 
to conditions (22) and the right part Fi — Difi, i = 1,2,... , N — 1, the 
estimate is valid: 


(31) 11% < llv’c • 

Proof In the case Di = 0 the estimate is obvious, since yi = 0 due to 
Corollary 2 to Theorem 1. By relating Di > 0 at least at one point we have 
occasion to use the function Yj > 0 , being a solution to the problem 

y 0 = y n =o. 


(32) C[Yi]=-Di\<pi 


i= 1,2,... ,N - 1; 
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The solution of problem (32) can be most readily evaluated with the aid of 
the relation \\y c < \\Y C> valid an account of Theorem 2. Let the maximum 
of the function Yi be arrived at a point i = i 0 . Then 

B io {Y io + 1 -Y io ) <0, Ai{Y io -Y io . i)>0 

and (32) implies the double inequality 

A-o Yi : < Di 0 \<fi 0 \ < Di : || <p c . 

In the case Di 0 > 0, it follows from the foregoing that 

(33) ||y c , < \\<p c . 

For Di 0 = 0 we deduce from (32) that 

Bio (Yi o+i-^o) = A 0 (y 0 -y 0 -i). 

With the relations Y; 0 > Y) i and Y) > Y) +1 in view, we find that 

Y{ 0 -\-i Y) 0 Yj 0 „i , 

it being understood that the same maximal value is attained at the adjacent 
to i 0 points. 

By merely setting i = — i : + 1 (or i 1 = i 0 — 1) we follow established 

practice and obtain, as a final result, the inequality 

Aj Yi % < Di 1 ■ || f c , 

giving either inequality (33) or the equality Y^ + i = Yq_i = Ijq . As 
Di ^ 0, we get Di a > 0 and inequality (33) for some i = i , thereby 
completing the proof. 

Theorem 4 The solution m of problem (25) with coefficients (22) admits 
the estimate 

(34,) l|y c <2||y c 

0 

where y is the solution of problem (28). 
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Proof Recall that the difference m = Hi — V i is the solution of problem 

0 

(29) with the right part Fi — Di Vi. The inequality 

11% = II y + u c - II y c + H u c 

in combination with estimate (30) leads to estimate (34). 

This provides reason enough to reduce proper evaluation of the solu¬ 
tion of the general problem (25) to that of the simpler equation (28), whose 
0 

solution Vi can be found in explicit form. 

9. Maximum principle for the third kind boundary-value problem. The 

maximum principle and its corollaries remain valid for the general bounda¬ 
ry-value problem (6), (8'), whose statement is 

£ [yi] = -Fi > i = 0, 1, 2, ... , N ; 

(21 ) F [y 0 ] — J/o T % Vi i F 0 — Mi i 

£ [ Vn ] M/v T ^2 Vn-\ ) £/V h'2 ) 

with the members C' 0 = 1, A 0 = 0, B 0 = x lt C N = 1, A N = x 2 and B N = 0. 
Theorem 1 (The maximum principle). Let under the set of the restrictions 
Ai > 0, Bi > 0 , Ci>Ai+Bi, i = 1, 2, ... , N - 1; 

(22*) 

0 < < 1 , 0 < >f 2 < 1 , 0<x 1 +>r 2 <2, 

the function y lt yi ^ const, satisfy the conditions 

£[t/i]>0 (£[yi]< 0), i = 0, 1, 2, ... , N . 

Then yi cannot take the maxima} positive (the minima} negative ) value at 
any node i = 0,1,2,... , N, that is, ip < 0 (t/,; > 0). 

The proof is analogous to that of Theorem 1 from Section 8. It is 
necessary only to consider, in addition, the following two cases: 

a) if i 0 = 0, that is, max; t/; — y 0 = M 0 > 0 and y t < M 0 , then 

F[y 0 ] = -y 0 + % Vi = -(! - %) y 0 - % (y 0 - Vi) < 0 


for 0 < x x < 1; 
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b) if i : = N, that is, max; t/,: = y N = M 0 > 0, but y N _ l < M 0) then 

£[y N ]=- -V N +* 2 2/w-i = “(! -^ 2 ) 2/w -^(Vn -Vn-J < 0 
for 0 < x 2 < 1. 

In both cases we came to a contradiction with the condition £ [yi\ > 0 
for all i = 0, 1, 2, ,. . , At. It is therefore concluded that yi < 0, since if 
yi > 0 at least at one point i — i t , its maximal positive value should be 
attained at some point i = i 0 (for example, at i 0 = ) that in principle is 

impossible. 

Corollary 2a Under conditions (22*) the problem 

£ [yi\ = 0 , i - 0,1,. .. , At 

has only the trivial solution. 

There is no difficulty to reformulate the remaining assertions from the 
previous sections, but we do not dwell on precise statements, 

10. Solution estimation for difference boundary-value problems by the elim¬ 
ination method. In tackling the first boundary-value problem difference 
equation (21) has the tridiagonal matrix of order At — 1 

3 1 0 ... 0 0 0 

Cry B 2 0 0 0 

0 0 ... a w _ 2 b n _ 2 

0 0 ... 0 -C N _, 

being symmetric for the case 

(35) B t = A f+ i . 

Difference equations with a symmetric matrix are typical in numerical 
solution of boundary-value problems associated with self-adjoint differential 
equations of second order. In what follows we will show that the condition 
Bi = Aj + i is necessary and sufficient for the operator £ [t/;] be self-adjoint. 
As can readily be observed, any difference equation of the form 

(36) Bi y i+1 - C, yi + A; 1 = -A;, y : = p 1 , y N =P 2 ’ 
Ai^O, Bi^ 0, i= 1,2,... ,N- 1, 
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can be made self-adjoint: 

A yi = a i+ 1 (y i+i - yi) - a; (t/; - 2 /*_i) - d; yi = -<# , 
i = 1 , 2 , 1 . 

Indeed, we multiply equation (36) by the function rji ^ 0 and involve 
the conditions A, rji = cq and Bi rji = cq +1 , whose use permits us to establish 
A i+ 1 77 i + i = a i+ 1 and 


Bi TT Bk 

m+i = i— hi = hi 11 


A 


/ + 1 




A fc 


+i 


where ^ is an arbitrary constant. As a result we get the equation Kyi — 
-<£>» with ^ = rji Fi and a, = Airy, d, = (Q - A,- - 5,) = q - a, - a, :+ i, 

C? — C) hi . 

By applying the elimination formulae to the problem 

(37) Kyi = a, y { _i - c; t/i + a i+i y i+i = -<pi , 

i - 1,2,... , N - 1, h 0 — 0 > h N — 0 , 

we deduce the estimate 

IV-1 


(38) 


||*< £ £ w 


under the natural premises 
(39) k-|>0, 


i=i |a ' +11 * = i 


|c,| > \a,i\ + \a i+l \ 


The computational formulae of the right elimination method help derive 
estimate (38): 


( 40 ) 


a i + l Ui+i + Pi + 1 , 

1 = 0,1,.. 

. ,N- 

1, 

y n 

= 0 , 

a i + l 

Ci Cii Q>{ 

i=l,2,.. 

■ ,N- 

1, 

a 1 

= 0, 

di Pi + <fi 

C{ Cti 

i= 1,2,.. 

■ ,N- 

1, 

A 

= 0 . 
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Since |a,: + i| < 1 under conditions (39), formulae (40) imply that 

\yi\ < l«i+il \yi+i\ + lA+il < \vi+i\ + lA+il. 

yielding, in turn, 

(41) \y t \ < E 1/3*1, 0<i< 7V-1, y N = 0. 

k=zi ~\-1 

Substitution j ,■ = cq Pi leads to the useful relations 

7i + l — a i + l (li + <Pi) . 

lTf+iI < \ii I + \<pi\ < Iti I + E \<Pk\ = E \<Pk\ 

k — 1 = l 

and, consequently, 

\@i \ < T~1 *E \ fk \ > 1 = 2,3,... , At , ^=0. 

I a »l *=i 

Combination of (41) with the foregoing allows us to establish (38). 

Before going further, observe that a solution to the problem 

(42) A m = —ipi , i — 1,2,... , TV — 1; y : = /j, 1 , y N = y 2 , 
can be majorized by 

N-l i 

11% ^ max (leil> M) + EchU \<Pk\ ■ 

i =i |ai+l1 *=i 

As stated in Corollary 3, a solution to the problem 

A&=0, i — 1,2,... , N — 1 ; y : - /j, l , y N = y, 2 , 

with a, > 0 and Cj > a; + a,y-i can be most readily evaluated by the 
quantities 

(43) ||% < rnaxd^J, \y 2 \) . 

The solution of problem (42) arranges itself as a sum yi = jji + iq, where 
the second summand is a solution of problem (37). Applying estimates (38) 
and (43), and the inequality \yp < \yp + |i>t| we come to the desired result. 
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11. The second-order difference equations with constant coefficients. If 

the coefficients of the difference equation 


(44) C [iji] = /k yi -1 - Ci yi + Bi y i+ i = 0 

do not depend on i, meaning A{ = a, C'i = c and Bi — b for all i = 1,2,..., 
a solution of the following equation 


(45) 


b y i+ i - c iji + a t/i_ i=0, b ± 0 , a yf 0 . 


may be found in explicit form. In so doing, let yf^ and be two solutions 
of difference equation (44) that are linearly independent if the equalities 

C iy \ l) ACj? = 0, i = 0 , 1 , 2 ,..., 

hold only for C 1 = C 2 = 0. This condition can be replaced by the usual 
requirement for the determinant of the system of algebraic equations 

C lV P + C i y? ) = 0 , 


C S l ) i r< ,,( 2 ) — n 


saying that, for all i and m 

Agz-j-m. — 


Vi 1} 

(2) 

Vi 

y\+m 

v {2) 

Di+m 


m ~ 1 , 2 ,... , 


# 0. 


By pursuing the parallel we see, in particular, that the condition 


A, ; 


i,i+i - 


yf } 

(2) 

Vi 


T 

y? ] 

y*+i 

(2) 

Vi +1 


Ah'’ 

A y( 2) 


# 0 


is analogous to that of the linear independence for solutions u(x) and u(x) 
of an ordinary second-order differential equation: 


u(x) u(x) 

(u(x)y (5(x)y 


# 0 


Eliminating and y)^) with the aid of equation (44) we get 


„(2 
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giving 

Ai 

Agi+i — — A.i t i- \ . 

Due to this fact the condition _ ; 1 + 1 7 ^ 0 for some i = yields A*,;+i # 0 
for all possibilities of i. 

Taking into account the equation C [yi\ = 0 we see that, for any m > 1, 
Agi+m can be expressed through and, hence, Agi+m 7 ^ 0 is ensured 

by the condition A»,»+i # 0 . 

If y'C and y\^ are linearly independent solutions of the homogeneous 
equation (44), then its general solution can be designed as a linear combi¬ 
nation of yi ^ and y?^ with arbitrary constants C 1 and C 2 . 

... _ r< A 1 ) 1 r< ? .( 2 ) 

V% — Dj y { + o 2 y { . 

The constants are free to be chosen from the initial or boundary conditions, 
since A* * +m 7 ^ 0 for all admissible subscripts i and m. 

The general solution of any nonhomogeneous difference equation 
C [yi\ = —Fj is representable by 

Vi = Ci 2/f ) + C 2 yf) + m , 

where yi is a particular solution to the equation C [yi\ = —T). 

In the case of the Cauchy problem with assigned values y 0 and y 1 , we 
have at our disposal the system of algebraic equations for constants C\ and 

C 2 : 

j Cl y< 1} + C 2 yi 2) = y 0 , 

{ C 1 y{ ) +C' 2 y{ 2) = t/L, 

As far as y'C and y^ are linearly independent, the condition A 0 a ^ 0 
provides a possibility of finding C 1 and C 2 . In the case of the boundary- 
value problem with y 0 = /i 1 and y N = y 2 incorporated, the constants C\ 
and C 2 can uniquely be determined under the agreement A 0 N 7 ^ 0. 

If the coefficients involved in equation (44) are constant, that is, A, = 
a, C{ = c and Bi = 6 , then particular solutions can be found in explicit 
form. This can be done by attempting particular solutions to equation (45) 
in the form t/j. = q k , while the number q 0 remains as yet unknown. 
Substituting y^ into (45) we obtain the quadratic equation for q: 


( 46 ) 


bq 2 — cq + a = 0 
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whose roots are 


?1 2 


c ± aAc 2 


4ab 


26 


Three possibilities of interest in accordance with the discriminant sign are: 

1) If D — c 2 — 4ab > 0, then the preceding equation has two distinct real 
roots 

c + \[T) c — \J~D 


h 


26 


<h 


26 


„(i) 


k „( 2 )_ k 


Two different particular solutions y\ ' = q~ ana y' k 
q 1 and q 2 are linearly independent, since 


q 2 corresponding to 


^fc,fc + l — 






9i 


k + I / 7 ^ + J- 


= (?2 “ 9l) l l 2 A 0 


and constitute what is called the general solution of (45): 

Vk = C 1 q\ + C 2 q 2 


where C 1 and C 2 are arbitrary constants, 

2) If D = c 2 — 4a6 = 0, then q 1 = q 2 = c/(26) = g 0 and = q£ and 
y^ = k q^ can be declared to be linearly independent particular solutions. 
Indeed, substituting y^ = k q^ into (45) we obtain by minor changes 

^yfh - c Vk ] + a y ( k -1 = [b(k + l)(j 0 2 - ckq 0 + a(k - 1)] q 1 ^ 1 

- ?o _1 k ( b l'o ~ c 1o + a ) +?o _1 ( b ll ~ a ) = ?o* _1 ( 6 ?0 - a ) = °. 


since 6 g 2 — a = 6 [ c/(26) ] 2 — a — Z?/(46) = 0. The discriminant 


Ajfc, jfc + l — 


?o k 9o 

?o +1 ( fc + 1 )?o +1 


= e +i 


AO 


assures us that q£ and k q * are linearly independent and can be chosen as 
a basis for constructing the general solution of (45): 


Vk — (C j + k C 2 ) q£ , q 0 — 


c 

26 
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3) If D = c 2 — Aab < 0, equation (46) possesses two complex-conjugate 
roots 


where 


9i = 

? 2 = 


P = 


c + VW\ * 

2b 

c-y/\D\i 

2b 


= p (cosip + i sin ip) = pe zv , 
= p (cos i p — i sin p) = pe~ lv 


ip = arctg 


^W\ 


i = y/—l. 


The appropriate functions 

q k = p k e 1 k v = p k (cos kip + i sin kip) , 
q k = p k e~ lklf> = p k (cos kp — i sin kip) 


or 


y[ l) = p k cos kip , j/jj 2 - 1 = p k sin kp 

are just particular solutions to equation (45). In this case both pairs of so¬ 
lutions are linearly independent in connection with the linear independence 
of the functions sin kp and cos kp: ^ 0. Then the general solution 

acquires the form 


Uk = p k (Cj cos kp + C 2 sin kp) . 

In order to illustrate our approach a little better, it seems worthwhile giving 
several simple examples. 

Example 1 We are interested in giving the general solution to the equation 
Vk+i — 2pyk + Dk~v — 0 , p> 0 . 

Still using the above framework with D = 4 (p 2 — 1), the following three 
cases need investigation. 

a) Let p < 1. Setting p = cos a, a yf 0, and y/. = q k we obtain the quadratic 
equation for q: 


q 2 — 2 cos a q + 1 = 0 
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with discriminant D = 4 (cos 2 a — 1) = —4 sin 2 a < 0 and roots q 1 2 = 
e ±? « 'j'jjgH qk ^ — e ±ikct, particular solutions are given by 

(i) / (2) . , 

y\ = cos ka > y\ = sm ka 

and the general solution can be written as 

y ,t = C\ cos ka + C 2 sin ka 

with arbitrary constants C 1 and C 2 . 

b) Let p > 1. Setting p — ch cr and yk = q k we get 

g 2 — 2 chag+l ;=0 

with discriminant D = 4 (ch 2 a— 1) > 0 and roots gj 2 = ch a±sh a = e ± 
Then q\ 2 = a , particular solutions become 

= ch ka , j/jj 2 -' = sh ka 

and the general solution can be written as 

yk = C\ ch ka + C 2 sh ka 
with arbitrary constants C\ and C 2 . 

c) Let p = 1. In this case, for yk = q k , we have g 2 — 2 g +1 = 0 and q 1 2 = 1. 
The particular solutions = 1 and y jj 2 -' = k form the general solution 
yk = C\ + C 2 i as a linear function. 


Example 2 It is required to calculate the integral 

7T 

, x f cos kxp — cos k(p 

h(<p) = / -:- t - 2 -#, k ~ 0 , 1 , 2 , ... . 

J cos ip — COS (p 

0 

First of all we note that 

4(^0 — 0 , I^ip) = f dip = IT. 

0 

We claim that Ik is just the solution of the Cauchy problem for the second- 
order difference equation: 


h +1 - 2 cos (p I k + h-i = 0 , 


k = 1 , 2 ,... , 


4 = 0 


4 = IT , 
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assuming p to be arbitrary fixed. Indeed, the chain of the identities occur: 

[cos (k + l)ip — cos (k + 1 ) <p] + [cos (k — 1 ) ip — cos (k — 1 ) i p] 

= 2 cos kip cos ip — 2 cos kp cos p 
— 2 (cos kip — cos kp) cos p + 2 (cos ip — cos 7 ?) cos fer/i, 
from which the relations immediately follow 


Ik + 1 + Ik-1 — 2 COS V? Ik + 2 


0 


(cos ip — cos 7 ?) cos kip 
cos ip — cos 


dip 


2 cos /j, + 2 J cos kip dip — 2 cos p Ik , k > 1 , 
0 


yielding 4 +1 - 2 cos 9 ? I k + h -1 = 0 . 

From Example 1, case a) we know that 


Ik{p) = Cj cos + C 2 sin kp . 

The initial conditions for k = 0 and k =. 1 give Cj = 0 and C 2 = 7 r/ sin 
in connection with the available information that C\ cos p + C, sin = 7 r. 
The outcome of this is 


h{p) 


sin kp 
sin p 


k = 0 , 1 , 2 ,.. . 


12. Formulae of “difference differentiation” by parts of the product and 
sum. The formula for differentiating the product of two real functions 
u(x) and v(x) 

d * s , . dt) du 

-(u( X )v( X ))=u( X ) Tx +v{x)- 

is well-known from differential calculus. In an attempt to establish a grid 
analog of this correlation, we consider any two grid functions yi and V{ of the 
discrete variable i = 0, ±1, ±2, .... The following formulae of “difference 
differentiation” are valid: 


( 47 ) 


A (yi - yi Avi+ v i+1 A y t = y i+1 A v { f«jAt/i, 

V (yi = j/i-i V Vi + Vi Vj/i = yi V Vi + ^-1 V yi 
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with the well-established notations of the right and left differences: A yi — 
Hi+i - Vi and V y t = y t - &•_i, so that V y i+ 1 = A y t . 

With this relation established, we find in a step-by-step fashion that 

y% A Vi + v i+1 A yi = yi {v i+ i - Vi) + ^'+1 (j/i+i - yi) 

= 2/t+i ^-+1 - yi Vi = A (?/,■ Vi). 

Likewise, one can check the second formula based on another relation 


V (yi Vi) = A (y*-! Vi-1 ) . 


An important role in the theory of difference schemes is played by the 
identities serving on this basis as grid analogs of integration by parts: 


u' V dx = U 'Ll I 


u v / dx 


For any functions yi = y(i) and Vi = v(i) defined on the grid ui = {* = 
0,1,2,... ,N), it will be sensible to introduce analogs of the integral 

(«,») 0 := Ja uvdx: 


(y, v ) := 


N- 1 

E Vi Vi 


1 = 1 


N 


(: y , ■y] : = T,ViVi, 

i = 1 


[y, v) : = 


IV-1 

E Vi Vi ■ 


i = 0 


With these, the summation by parts formula hholds: 


(48) (y, An) --(v, Vy\ + y N v N - y 0 v x . 

With this aim, we replace t/ 8 - A»j by its expression (47): 


yi A Vi = A (yi v^ - v i+l V y i+i 


in the sum 


(y, Av) — 


N- 1 


E 


Vi A Vi 


N -1 


E A (yi Vi) 


N -1 

E v i+i V y i+l 

i = 1 


= Vn V n - Vi V ! 


N 

E v y v , 


i / = 2 
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where i' — i + 1. For y y = y : + (y l — y : ) = y : + V y l we arrive at 

N 

( V, A v) = y N v N - y 0 v l - )T) ^ V yi = ~{v, Ay\ + y N v N - v 1 y 0 . 

i = 1 

If yi vanishes at the boundary grid nodes i = 0 and i = N , that is, either 
2/o = 0, y N = 0 or u 0 = 0, n N = 0, then (48) can be rewritten in the form 

(49) (y, An) = -(n, V y\ . 

The identities obtained above are frequently encountered in difference trans¬ 
formations and calculating various finite sums and series. We give below 
some examples of such applications. 

Example 1 It is necessary to calculate the sum S N = Ehi®' 2 *- By 
setting yi = i and An; = 2 l so that 

v i+i = Vi + 2 * = 22 2 k + n 0 = 2 l+1 — 1 + n 0 
k~0 

and choosing n 0 in such a way that n N+] = 0 we are led by formula (48) to 

N N ;V + i 

E * 21 = T, Vi Ay i = ~ E v i V y t + y N+J v N+l - y 0 Vy 

i -=1 2 = 1 2 = 1 


= - ^ ( 2 i - 2 N+1 ) = - 2 ( 2 n+1 - 1) + 2 N+1 (N + 1) 


= (A - 1) 2 n+1 + 2. 


Example 2 Of interest is the sum S N = EiLi 1 *' aJ - I n this case Vi = *> 
An; = a 1 , Vj, = (a* — a N ) / (a — 1), n N =0 and 

E = ^,^2 [ ci N (fV(a—1) — a)+a], 

13. Green’s difference formulae. For the simplest operator Lu~u n the 
following identities are valid: 


b 


/ u v" dx 


a 


b 


v' dx ■ 


b 

a ’ 


a 


[ uv" — u" v ) dx = ( u v' — u! V ) 


b 


b 

a 
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which are called the first and the second Green formulae. Usually the 
first formula can be modified into a more general form, namely 

b b b 


(50) 


u Lv dx 


k v! v' dx 


quv dx + kuv' 


b 

a 


a 


a 


a 


with L v := (k v')' — q v. 

Making here the mutual replacements of u{x) and v(x) and subtracting 
the resulting equation from (50), we establish the second Green formula in 
a more general form 


(51) = k(uV-u'v)t 

a 

If, in addition, u and v vanish at the end points x = a and x = b, then all 
preceding substitutions are equal to 0, thereby reducing formulae (50)—(51) 
to 


(52) (u, Lv) 0 = -(ku 1 , v') 0 - (qu, v) 0 , (u, Lv) 0 = (v, Lu) 0 

where as usually (u,v) 0 = f^uvdx. 

In particular, we might have 

(u, L u) 0 = -(k, ( u' f ) 0 - (q, u\ . 

Observe that the equality (u, Lv) 0 = (v, Lu) 0 means the self-adjointness 
of the operator L. 

In the further development of the difference analogs of formulae (50), 
(51) and (52) = V Uj is put together with (48): 

(53) (y, AV u) = - (V u, V y] + y N Vu N - y 0 Vu 1 . 

Likewise, setting Vj = ajVitj one obtains instead of (53) one more useful 
result 


(54) (y, A (a V u)) = -(a Vu,Vy] + y N a N Vu N - y 0 a 1 Vu 1 . 
Applying (54) to the difference operator 

(55) A Ui — A(ci ? '\7"Uj) d{ U( — cij_|_j('u^_l_i ^i) — i) U{ 
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yields the first Green formula 

(56) (y, Au) = - (a Vti, Vy] - (du, y ) + (ayVu) N - y 0 (aV u) 1 , 

which can be viewed as an analog of (50). After interchanging in (56) the 
positions of u,- and yi we get the equation 

(u, A y) = -(a V y, Vtij - (dy, u) + (ayV y) N -ti 0 (aV y) x , 

which will be subtracted at the next stage from (56). The final expression 
leads to the second Green formula 

(57) (y, Au) — (u, Ay) = a(yV u- uV y) N - a 1 (y 0 V u l - u 0 V y l ). 

In the particular case when a; = 1 and di = 0, that is, for 

A yi := AV yi = A 2 ^-! 

Green’s difference formula admits an alternative form 

(y, AV u) = (u , AV y) + (yV u - u Vy) N - (y A u - u A y) 0 

- (u, AV y) + u N y N _, - y N u N _ 1 +u 0 y 1 - y 0 u x , 

which allows a more simpler writing of the ensuing formulae. When y 0 — 0 
and y N — 0, the first Green formula becomes 

(58) (y, Au) - -(aV u, V y) - (du, y ), 
giving for u — y 

(59) (y, Ay) = -(a V y, Vy) - (d, y 2 ). 

For any y and u subject to the homogeneous boundary conditions y 0 — 
y N — 0 and u 0 = u N =0, the second Green formula takes a very elegant 
form 


( 60 ) 


(Ay, u) = (y, Au). 
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1.2 SOME VARIANTS OF THE ELIMINATION METHOD 

1. The flow variant of the elimination method for difference problems with 
widely varying coefficients. In numerical solution of thermal-flow hydrody¬ 
namics and magnito-hydrodynamics problems in which the coefficients of 
heat conductivity and electric conductivity depend on the thermodynamic 
parameters of the medium the elimination method for the corresponding 
difference equations leads to unsatisfactory results. In thermal problems 
adiabatic cells with infinitely large thermal-flow reveal themseves. The 
nonconductive cells or ideal conductivity may appear in magnetic prob¬ 
lems, thus causing obstacles in connection with widely varying coefficients 
and considerable accuracy losses. In mastering the difficulties involved, 
the flow variant of the elimination method is aimed at solving a revised 
supplementary problem relating to the heat flow. 

The statement of the boundary-value problem is 

(61) y i _ l ~ a yi + a i + i y i+l = -/) , i = 1, 2, . . . , N - 1 , 

(62) y 0 = Xj y x + v l , y N - x 2 y N _ , + v 2 , 

with the members 

Cj = a,- + i + a, + di , di > 0, 0 < a, < oo , 

(63) 

1 Xy , X 2 ^ 0 , Xy X 2 ^ 2 . 

Having stipulated condition (63), the computational formulae of the right 
elimination with regard to problem (61)—(62) can be written as 

iji - dj+i y i+ 1 + /S i+ 1 , i = 0, 1, 2, .... N - 1, 

__ o-i + l 

(64) dj+i + o-i (1 ~ cti ) + di 

Pi+i = Pi + fi) , i = 1, 2, . . . , /V - 1 . 

o-i + l 

A new unknown difference function is called a flow and is defined by 
Wi := cii (yi-1 - yi ) , 


( 65 ) 
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making it possible to rearrange the problem statement and boundary con¬ 
ditions (61)—(62) as 


(66) Wi - w i+l - diyi = -fc , i = 1,2,... , N - 1 , 

(67) a 1 (l - xj y x + w 1 = a x , a N (l ~ x 2 )y N - x 2 w N = a N v 2 . 

Substituting y t = yi + i + uy + 1 /ai +1 from (65) into the first formula (64) 
yields 

( 68 ) ai + i (1 — dj+i) t/i +1 + tei+i = a^+i /?*+i • 

To make our exposition more transparent, we introduce ay = cy (1 — on) 
and ji = a.i Pi. With these, equation ( 8 ) admits the simplified form 


(69) 


ai Vi + Wi - 7 i 


showing the new notations to be sensible ones. Having completed the elim¬ 
ination of yi from ( 66 ) and (69), we arrive at 


(70) 


<Y i di 7 i Oy fi 

Wi+l - 


<+i + cli c+i + di 

In so doing ay and ji are recovered from the recurrence relations 

a i+ 1 [ o,i (1 — ay) + di ] 


a i +1 — a i + l ( 1 ~ C W + 1 

ay + di 


a i+i + (ii (1 — di) + di 


a i + 1 


1 + (<*i + dp / ai- |-i 

( 71 ) 7 i + l = a i +1 Pi +1 — “i + l ( a i Pi + fi) — 


i + 1 {ji + fi) 


t'+l + a i (1 — &i) + dj. 


or 


(72) ji+i = 


H + fi 


1 + (<*» + d t ) / cii+i 


By comparing the first boundary condition (67) with (69) for i = 1 we find 
that 


ay = a l (1 - Xj) , 


(73) 


7i = • 
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We note in passing that formulae (71)—(72) just established are very flexible 
and more convenient for computational procedures in the case a, >> 1. 

The requirement a 8 << 1 necessitates making some modifications for 
stability of this or that difference scheme. As a final result of minor changes, 
the recurrence formulae have the representations 


(71*) 

(72*) 


aj +1 (eg + dj) 
a i + l + i a i + d-i) 


+ l (T “b fi ) 
a i +1 + ( a i + d{) 


Under conditions (63) formulae (71) and (71*) imply that a 8 > 0. This 
provides support for the view that the coefficient a, / (a 8 + d,j) in (70) is 
always less than 1, providing stability in the process of calculations of the 
flow U>i. 

For determination of i/i we rely on the appropriate formulae: for a 8 >> 

1 


(74) 


Vi — CU + l Ui +1 + Pi +1 


a i +1 

Uf-J-I 


Vi+\ 


7i +1 

a *+1 


and for a, << 1 


(75) 


Vi - 


^'+i 


a i+l + a i + di 


Vi+l 


li + fi 


a i + l + a i + di 


Formulae (74)-(75) show that the elimination method is stable. The 
values w N and y N should be known before proceeding to the applications 
of (70), (74) and (75). For this reason we involve here the second boundary 
condition (67) and relation (69) for i — N: 

a N V 2 + IN *2 _ In a N (1 ” X 2 ) ~ a N a N V 2 

Vn /1 N . > W N / i \ . 

Q, N (1 ^ 2 ) ~b ^2 ®N ^N (1 ^ 2 ) “b ^2 ®N 


Observe that under conditions (63) the denominators in relevant expressions 
are always positive. 

To distinguish two essentially different approaches, the final algorithm 
is of rather complicated structure and consists of the following steps: 

• specification of a 1 = a 1 (1 — xf) and j l = a l v l ; 
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• successive refinement of the coefficients for i — 1, 2,. .. , N — 1 with the 
aid of the relations 


®i +1 


7 »+i 


( a i + di) (1 + (ai + di) cq+j) 

fli+1 > 1 

a i+i ( a i + di) (cq+i + (ay + dj)) , 

ai+l < 1 

(li + /*)(! + (“« + dj) a i + i ) , 

«i+i > 1 

a i + l ( 7 « + fi) ( a i+l + ( a i + di)) , 

a i+ i < 1 


revision of proper boundary conditions 

^2 + In ^2 
1- x 2 + x 2 a N a- 1 

a N + In *2 
a N (! - ^2) + ^2 a N 


a N > 1 
a., < 1 


w lS , = 


7v (1 ~ ^ 2 ) ~ °N V 2 

1- x 2 + x 2 a N a~ 1 

1N (1 ^ 2 ) ' l (y ^2 ^ 


N 


(! - ^ 2 ) + ^2 “ 


a„ > 1 


, «„ < 1 . 


N 


• successive determination of solutions for i = N — 1, At — 2, . . . , 0: 
oa di 7 i - cti fi 


W; 


Vi = 


oti + di 


Wi+ 1 


1 ai+1 , 

1 -I 2/i+i 


&’i +1 
1 


a, + cli 
H+i 


) 


a i+l 


Vi+l 


li + /i 


aj+i > 1 , 
, a i+ 1 < 1 . 


a i+l + a i + di a i+l + &i + di 

Let us stress that the computational algorithm given above is stable. 

2. ^Cyclic. elimination method. We now focus the reader’s attention on 
periodic solutions to difference schemes or systems of difference schemes 
being used in approximating partial and ordinary differential equations in 
spherical or cylindrical coordinates. A system of equations such as 




A lh "L ^1 I /2 — fi 1 


(76) a t iji_ 1 - a yi + b t y i+ i = -fi , 
aN Vn~ 1 Hv ~f Vl fN > 


2, 3, ... , N - 1, 



38 


Preliminaries 


was quite applicable in determination of the periodic solution yi+ N = yi of 
problem (61): a; j/ 2 _i — c; yi + bi j/j + y = —provided that the conditions 
of periodicity 

a i + N — a i > bi + N — , C i + N — c i , fi + N — fi 

and the additional conditions 

( 77 ) a{ > 0 , bi > 0 , Ci > a { + bi 

hold. 

We give below without proving the algorithm of the cyclic elimination 
method which will be used in the sequel: 


(78) Qi+i 


Ci ai (Xi 


h i 

a, = — 


ft + 1 


fi + a i Pi 

Ci (1% Ot% 


* = 2,3,... , N ] 

ft = - , 


7*+i 


^2 7i 


Ci — (L{ Ct{ 


72 


(79) Pi — aq + 1 Pi + l + ft+l , Qi — Qi +1 Qi +1 + 7i + l , 

i = N~ 2, IV -3,... ,1; 


Pn~i ft/ ! 


“n+t n ; 


_ Pn + 1 T + l Pi 

“ , 

1 ~~ Q' jV + 1 <h 7jV + 1 

(80) yi=pi + y N qi, i = 1,2,... ,tv - l. 


This algorithm is stable because the solutions of (79) are found by 
the right elimination method being stable under conditions (77) with the 
denominator 1 —a N+1 q 1 —j N+l > 0. Indeed, it follows from (77)-(78) that 
ai < 1, ji > 0 and a 2 + j 2 < 1, Assuming a* + ji < 1 we get 


(81) 


bi + a { 7 i bi + ai - ai 

T+i+Ti+i — - < - < I- 

Ci C%i Ci (li a t 


Combination of (79) with (81) gives q K _ 1 < 1 and qi < 1, thereby justifying 
the relation 1 - a N+1 q 1 - q N+1 > 0. 
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3. Factorization method. At the final stage other ideas are connected with 
the boundary-value problem 


Lijk = A k r - C k ijk + B k ijk + i = -F k , k = 1,2,... , N - 1, 

(82) 

Vo = *5 Vl + V 1 > Vn = X 2 Vn- 1 + ;y 2 ■ 

By introducing the transition operator T: T y k = Uk+i and the iden¬ 
tity operator E: E y k = y k and obvious rearranging of the left-hand side of 
(82) as a product 

(b k T — A k ) (ctk T — E) y k -\ = (b k T - A k ) (a k y k - y k ^) 


— b k a*;-i-i y k .|-i — (A k a k + b k ) y k + A k y k -\ , 


where 


aib + i b k — B k , A k a k + b k = C k , 


we find during the course of the elimination of b k = C' k — A k a k that 


(83) a* +1 = - , k=l,2,...,N-l. 

C k - A k a k 

The factorized equation 


(b k T~ A k ) ( a h y k - y k - 1 ) = -F k 


can be solved using the following algorithm: 

• recovery of the function f3 k from the equation 

(b k T — A k ) (3 k = b k p k + i — A k (3 k = F k 


(84) p k + l = ^ k( ^ k + Fk , k = 1, 2, ... , AT-1; 

C k - A k a k 


• determination of y k by the right elimination method. The outcome of 
this procedure is 


(85) y k = a k+1 y k+1 + ,8 k+l , 


k = 0, 1, ... , N - 1 . 
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with the coefficients a k and f3 k emerging from (83)—(84). The complete 
posing of the problem consists of (83)—(85), which are supplemented with 
the initial conditions 


( 86 ) 


A = c 


2/a 


^2 Pn + V 2 

1- x 2 a N 


With the right and left differences Av k = v k + i — v k and 
v k — Vk-y i n the usual sense, the operator 


Ly k = A k y k -i - C k y k + B k y k +1 


can be factorized by letting 

L — L 1 L 2 , L 1 — b k A + y k , L 2 — V + ( a k — 1). 

The equality L 1 L 2 y k — L y k holds true if 

Jk = bk ~ A k , a k + i b k = B k , A k a k + B k a k ^ = Ck ■ 

The same procedure works for eliminating y k and b k on the basis of formulae 

(83)—(86). 
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of Difference Schemes 


In this chapter elementary examples illustrate the basic concepts of the the¬ 
ory of difference schemes: approximation, stability and convergence. The 
reader is already familiar with several methods available for investigating 
stability and convergence such as the method of separation of variables and 
the method of energy inequalities. In Section 4 difference equations are 
treated as operator equations in an abstract space. These provide a means 
of studying a wide range of interesting methods in a unified manner. We 
begin our exposition with a discussion of examples that make it possible to 
draw fairly accurate outlines of the possible theory regarding these ques¬ 
tions and with a listing of the basic results of the book together with a 
development desired for them. 


2.1 RELEVANT ELEMENTS OF FUNCTIONAL ANALYSIS 

Our account of the theory of difference schemes is mostly based on ele¬ 
mentary notions from functional analysis. In what follows we list briefly 
widespread tools adopted in the theory of linear operators which will be 
used in the body of this book. 

1. Linear operators. Let X and Y be normed vector spaces and V be a 
subspace of the space X. If to each vector x £ there corresponds by an 
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approved rule governing what can happen a vector y = Ax £ Y, we say 
that an operator A is given on V (or in X) with values in Y. The set V is 
called the domain of the operator A and is denoted by V(A). The set of all 
vectors of the form y = Ax, x 6 X>(A), is called the range of the operator 
A and is denoted by 7Z(A). It is customary to use also the well-established 
notation A(x) instead of Ax. 

Two operators A and B are said to be equal if their domains coincide 
and for all x 6 X>(A) = V(B) the condition Ax = Bx holds true. 

An operator A is called linear if it is: 

1) additive, meaning that for all x 1 , x 2 6 V(A) 

A(x i + x 2 ) = Ax j + Ax 2 ; 

2) homogeneous, meaning that for all x £ V(A) and any number A 

A(As) = A Ax. 

A linear operator A is said to be bounded if there is a constant M > 0 
such that for any x £ V(A) 

(1) ll^ll 2 < Af || a: II, 

(here || • || and || ■ || 2 are admissible forms of the functional norms on the 
spaces X and Y, respectively). 

The minimal constant M satisfying condition (1) is called the norm 
of the operator A and is denoted by ||j4||_y_ ( y or simply || A ||. 

It follows from the definition of norm that 

II As II 

(2) \\A\\= sup ||As|| 2 or || A|| = sup 1 2 . 

II x 11} =1 xjto || £ 11} 

It is worth noting here that in a finite-dimensional space any linear operator 
is bounded. All of the linear bounded operators from X into Y constitute 
what is called a normed vector space, since the norm || A|| of an operator 
A satisfies all of the axioms of the norm: 

1) || A || > 0; if || A || = 0, then || Ax || 2 = 0 for all x and A = 0; 

2) || AA || = | A | ■ || A||; 

3) II A + -B || < || A || + || -B ||. 

We will denote by A h X the set of linear bounded operators with the 
domain coinciding with X and the range belonging to X. On the set X X 
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it is possible to introduce the operation of multiplication AB of operators 
A and B: ( AB)x = A(Bx), Clearly, AB is a linear bounded operator in 
light of the obvious relation || AB || < || A || • || B ||. If ( AB)x = ( BA)x for 
all x £ X, then operators A and B are said to be commuting. In that 
case we will write AB = BA. 

While solving equations of the form Ax = y we shall need yet the 
notion of the inverse A -1 . Let A be an operator from the space X into 
the space Y. By definition, this means that V{A) = X and 71(A) ~ Y. 
If to each y £ Y there corresponds only one element x £ X , for which 
Ax — y, then this correspondence specifies an operator A -1 , known as the 
inverse for A, with the domain Y and range X. By the definition of inverse 
operator, we have for any x £ X and any y £ Y 

A~ l (Ax) = x , A(A~ 1 y) = y . 

It is easy to show that if an operator A is linear, then so is the inverse A -1 
(if it exists). 

Lemma 1 In order that an additive operator A with V(A) — X and 
71(A) = Y possess an inverse, it is necessary and sufficient that Ax — 0 
only if x = 0 , 

Theorem 1 Let A be a linear operator from X into Y . In order that the 
inverse operator A _1 exist and be bounded , as an operator from Y into X, 
it is necessary and sufficient that there is a constant 6 > 0 such that for all 

xex 

(3) II ^|| 2 > 6IMI, 

(|| ■ ||j is the norm on the space X and || • || 2 is the norm on the space Y). 
Moreover, the estimate ||A _1 || < 1/6 is valid. 

2. Linear bounded operators in a real Hilbert space. Let H be a real 
Hilbert space equipped with an inner product (x,y) and associated norm 
|| x || = \J(x, x). We consider bounded linear operators defined on the space 
H (77(A) = H). Before giving further motivations, it will be convenient to 
introduce several definitions. We call an operator A 
(a) nonnegative if 


(4) (Ax, x) > 0 for all x £ H ; 

(b) positive if 

(5) (Ax, x) > 0 for all x £ H except for x = 0 ; 
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(c) lower semibounded if 

( 6 ) (Ax,x) > — c* || x || 2 for any x £ H , 

where c* is a positive number; 

(d) positive definite if 

(7) (Ax, x) > 8 || x || 2 for any xE H, 
where 8 is a positive number. 

For an arbitrary nonnegative operator A and x £ H , the number 
(Ax.x) is called the energy of the operator A. Further comparison of 
operators A and B will be carried out by means of the energy. If ((A — 
B)x,x) > 0 for all x, we write A > B. In particular, inequalities (4)-(7) 
can be replaced by the following operator inequalities: 


meaning (Ax, x) > 0 , 

meaning (Ax, x) > 0 , 

meaning (Ax, x) > —c* \\x\\ 2 , 

meaning (Ax, x) > 8 || x || 2 , 

where E stands for the identity operator leaving a vector x unchanged: 
Ex ~ x. 

It is straightforward to verify that the relation established on the set 
of linear operators (H H) possesses the following properties: 

(a) A > B and C > D imply A + C > B + D\ 

(b) A > 0 and A > 0 imply AA > 0; 

(c ) A > B and B > C imply A > C; 

(d) If A > 0 and A ~ 1 exists, then A -1 > 0. 

If A is a linear operator defined on H , then the operator A* on H 
subject to the condition (Ax,y) = (x,A*y), x, y £ H, is called the adjoint 
operator to A. If A is a linear bounded operator, then its own adjoint is 
uniquely defined and falls within the category of linear bounded operators 
with the norm || A* || = || A ||. A linear bounded operator A is called self- 
adjoint if A* ~ A, that is, (Ax,y) = (x,Ay) for all x, y £ H. If A is an 


( 8 ) 


A > 0, 

A > 0, 

A > —c* E , 
A > 8E, 
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arbitrary linear operator, then A*A and AA* are self-adjoint nonnegative 
operators; 


(A* Ax, y) = (Ax, Ay) = (x, A* Ay), (A* Ax, x) = || Ax || 2 > 0 , 

(AA* x,x) = || A* x || 2 >0, 

It is worth noting the obvious relations (A*)* = A and (A *) -1 = (A -1 )*. 

Any nonnegative operator A in a complex Hilbert space H is self- 
adjoint: 


if (Ax,x)> 0 for all x£H, then A = A*. 

For real Hilbert spaces this statement fails to be true. As far as only real 
Hilbert spaces are considered, we will use the operator inequalities for non¬ 
self-adjoint operators as well. 

Theorem 2 The product AB of two commuting nonnegative self-adjoint 
operators A and B is also a nonnegative self-adjoint operator. 

An operator B is called a square root of an operator A if B 2 = A. 

Theorem 3 There exists a unique nonnegative self-adjoint square root B 
of any nonnegative self-adjoint operator A commuting with any operator 
which commutes with A. 

We denote by A 1 / 2 the square root of an operator A. 

Let A be a positive self-adjoint linear operator. By introducing on 
the space H the inner product (x,y) A = (Ax,y) and the associated norm 
|| x = \J(x, x) A we obtain a Hilbert space Ha, which is usually called 
the energetic space Ha- It is easy to show that the inner product 

(x,v)a - (Ax, y) 

satisfies all of the axioms of the inner product: 

(1) (x,y)A ~ (y,x) A ; 

(2) (x + y, z)a — ( x , z)a + (y, z )a ; 

(3) (\x,y) A = X(x,y) A ; 

(4) (x, x)a > 0 for x yf 0 and (x, x) = 0 only for x — 0. 

Axioms (2) and (3) are met by virtue of the linearity property. The 
validity of (4) is stipulated by the fact that the operator A is positive. The 
meaning of the self-adjointness of the operator A is that we should have 
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(x, y) A = (y,x) A or ( Ax,y ) = ( x,Ay) = ( Ay,x ). The axioms of the inner 
product imply the Cauchy-Bunyakovskii inequality 

\{ x , v)a I < IMI 4 ■ IIj/IU 

and the triangle inequality 

ll* + ylL<IML + IML- 

This profound result is covered by the following assertion. 


Lemma 2 For any positive self-adjoint operator A in a real Hilbert space 
the generalized Cauchy-Bunyakovskii inequality holds: 

(9) (Ax,y) 2 <(Ax,x)(Ay,ij) . 


Remark The preceding inequality remains valid in the case when A is a 
nonnegative operator. 

If A is a self-adjoint operator for which A -1 exists, its “negative” norm 
can be defined by 


( 10 ) IML 

In this line, we claim that 


_! = \/(A l <p,<p). 


(100 


^> 11,-1 = sup 


K^O 


•r *0 II x IU 

Indeed, we deduce from inequality (9) that 

\{<p,x)\ = \ (a - V, Ax) | < |ML-i • 

yielding 

I (¥>,*) I ^ IM U-i ' IML „ , 
SU P li—0— ^ SU P -n—Ti- = IM 

||® 11,4 x±0 11 ® 114 


\A ’ 


On the other hand, for x = A l <p it is plain to show that 


I (<P,x) I _ {A, A V) 

IML \JiAA~ 1 tp, A~ 1 tp) 
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which confirms the equivalence of ( 10 ) and ( 10 '). 

In the sequel sufficient conditions for the existence of a bounded in¬ 
verse operator A^ 1 defined in the entire space H , 77(A~ ] ) — H , will be of 
great importance for us. 

We note in passing that Lemma 1 and Theorem 1 guarantee the ex¬ 
istence of an inverse operator defined only on 71(A), the range of A, which 
is not obliged to coincide with H. If the range of an operator A happens 
to be the entire space H, 71(A) = H, then the conditions of Lemma 1 or 
Theorem 1 ensure the existence of an operator A~ l with 77(A~ l ) = H. In 
particular, a positive operator A with the range 7Z(A) = H possesses an 
inverse A~ Y with £ ) ( J 4“ 1 ) = H, since the condition (Ax,x) > 0 for all x yf 0 
implies that Ax yf 0 for x yf 0 and Lemma 1 applies equally well to such a 
setting. 

Theorem 4 Let A be a, linear bounded operator in Hilbert space H, 
77(A) = H. In order that the operator A possess an inverse operator A -1 
with the domain V(A~ 1 ) = H, it is necessary and sufficient the existence 
of a constant S > 0 such that for all x 6 H the following inequalities hold: 

|| Az || > 6 || x ||, || .4*11| >5 || 1 1|. 

Moreover, the estimate || A~ ] || < 1/6 is true. 

Corollary Let A be a positive definite linear bounded operator with the 
domain 77(A) = H. Then there exists a bounded inverse operator A~ 1 with 
the domain V(A~ l ) — H. 

Indeed, with the relation A > 6E , 6 > 0 in view, we arrive at the 
chains of the relations 

|| Ax || • || x || > (Ax, x) > 6\\x || 2 , 

|| A*x || ■ || x || > | (A*x, x) | =: | (x, Ax) | = (Ax, x) > 6 || x || 2 , 

thereby providing the relations || Ax || > 6 || x || and || A*x || > 6 || x || as well 
as the validity of the conditions of Theorem 4. The norm of the inverse 
admits the estimate A~ l <1/6. 

Remark For the existence of an inverse A -1 in a finite-dimensional Hilbert 
space it suffices to require the positiveness of the operator A, since the 
condition A > 0 implies the existence of a constant 6 > 0 such that 


(Ax, x) > <5|| x 


2 
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for all i, As a matter of fact, 

(Ax, x) = (A 0 x, x), 

where Aq = (A + A* )/2 is a self-adjoint operator. Hence, (Ax, x) > <5|| x || 2 , 
where 6 is the smallest eigenvalue of Aq. The number 6 cannot vanish due 
to the positiveness of the operator A. 

For the sake of simplicity we will assume in the body of this book that 
H is a finite-dimensional space. 

Recall that the norm of an operator A is defined by 

\\ A \\= SU P ll^ll- 

With this, for any self-adjoint operator A the following relations occur: 

(ii) imi = sup i (Ax,x )i = mu = sup . 

11*11=1 IMI^O 11*11 

Lemma 3 If S — S* is a linear bounded operator and n is a positive 
integer, then 

immmm 

Proof We proceed to prove this assertion by induction on n. Let n = 2. 
Then 

||5 2 ||= sup | (S 2 x, x) | = sup || Sx || 2 = || S || 2 , 

ll*ll=i ll*ll=i 

meaning || .S ’ 2 || = || 5' || 2 . Assuming that relation ( 12 ) is valid with n = k — 1 
and n = k, we are going to show that it continues to hold for n = k + 1 , 
k > 1 . Indeed, 

||5 2fc ||= sup | (S 2k x, x) | = sup | (5* +1 ;e, S k ~ 1 x) \ 

11*11=1 ll*ll =1 
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Lemma 4 If A is a self-adjoint positive bounded operator, then the esti¬ 
mate is valid: 


(13) \\Ay\\ 2 <\\A\\(Ay,y). 

Since A* = A > 0, there always exists the operator A 1 -!' 2 . By merely 
setting v = A l ! 2y we obtain 

(Ay, Ay) = ( Av, v) < || A || • || v || 2 = || A || (Ay, y) . 


3. Linear operators in finite-dimensional spaces. It is supposed that an 
n-dimensional vector space R n is equipped with an inner product ( , ) and 
associated norm ||a;|| = \J(x, x). By the definition of finite-dimensional 
space, any vector x 6 R n can uniquely be represented as a linear combina¬ 
tion x = Cj + • • • c„ of linearly independent vectors , . .. , £ n , which 
constitute a basis for the space R n . The numbers c k are called the coordi¬ 
nates of the vector x. One can always choose as a basis an orthogonal and 
normed system of vectors . ,£ n : 


(£i > £k) ~ &ik 



i ± k , 
i = k , 


by means of which it is possible to write c k = (x,£ k ). 

Let A be a linear operator in the space R n , Any operator A in the basis 
. , £ n can be put in correspondence with an n x n matrix 21 = (a ik ), 
whose element ci ik is the ith component of the vector Atj k . Conversely, any 
matrix 21 = (a ik ), i, k = 1 , . . . , n, specifies a linear operator. 

The matrix of a self-adjoint operator in any orthonormal basis is a 
symmetric matrix. 

Let us dwell on the properties of eigenvalues and eigenvectors of a 
linear self-adjoint operator A. A number A such that there exists a vector 
£ ^ 0 with A£ = A£ is called an eigenvalue of the operator A. This vector 
£ is called an eigenvector corresponding to the given eigenvalue A. 

1. A self-adjoint operator A in the space R n possesses n mutually 
orthogonal eigenvectors , . . . , £ n . We assume that all the £ k ’s are nor¬ 
malized, that is, ||£j.|| = 1 for k = 1, ... ,n. Then (^, £ k ) = S ik , The 
corresponding eigenvalues are ordered with respect to absolute values: 


I ^ | < | A 2 | < ■ ■ • < | A„ |. 


2. If a linear operator A given on R n possesses n mutually orthogonal 
eigenvalues, then A is a self-adjoint operator: A = A*. 
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3. If A* = A > 0, then all the eigenvalues of A are nonnegative. 

4. Any vector x 6 R n is representable by the eigenvectors of any 
operator A = A*: 

n n 

X =E c kik, c k = (x,£ k ) and INI 2 = E c)i. . 

jfc = 1 k -1 

5. Let A* — A > 0 (A is self-adjoint and nonnegative). Then 

V INI 2 < (^x,x) < A n ||x || 2 


and 

Aj || x || < || Ax || < A n || x || for all x 6 H , 

where Aj > 0 and A n > 0 are, respectively, the smallest and greatest 
eigenvalues of A. The norm of a self-adjoint nonnegative operator in the 
space R n is equal to its greatest eigenvalue: || A || = A n . 

6. If self-adjoint operators A and B are commuting (AB = BA), then 
they possess a common system of eigenvectors. 

7. Let self-adjoint operators A and B be commuting (AB = BA). 
Then the operator AB possesses the same system of eigenvectors as the 
operators A and B and A^g = A^ Ag\ k = 1,2,... ,n, where A^g Ag\ 
and A^ are the k th eigenvalues of A, B and AB = BA, respectively. By 
the same token, 

_ \C*) . \C*) 

a a+b — a a + a b ■ 

2.2 DIFFERENCE APPROXIMATION OF ELEMENTARY 
DIFFERENTIAL OPERATORS 

1. Grids and grid functions. The composition of a difference scheme ap¬ 
proximating a differential equation of interest amouts to performing the 
following operations: 

• to substitute the domain of discrete variation of an argument for 
the domain of continuous variation; 

• to replace a differential operator by some difference operator and 
impose difference analogs of boundary conditions and initial data, 

Following these procedures, we are led to a system of algebraic equations, 
thereby reducing numerical solution of an initial (linear) differential equa¬ 
tion to solving an algebraic system. 
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We would like to discuss the questions raised above in more detail. 
Obviously, in numerical solution of mathematical problems it is unrealistic 
to reproduce a difference solution for all the values of the argument varying 
in a certain domain of a prescribed Euclidean space. The traditional way 
of covering this is to select some finite set of points in this domain and look 
for an approximate solution only at those points. Any such set of points is 
called a grid and the isolated points are termed the grid nodes. 

Any such function defined at nodal points is called a grid function. 
Thus, the first step in this direction is to replace the domain of continuous 
variation of an argument by a grid, that is, by the domain of discrete 
variation of the same argument. In other words, we have approximated the 
space of solutions to a differential equation by the space of grid functions. 
For this reason the properties of a difference solution and, in particular, its 
proximity to an exact solution depend essentially on a proper choice of the 
grid. It seems worthwhile giving several simple grids to help motivate what 
is done. 

Example 1. An equidistant grid on a segment. The segment [0,1] 
of unit length is splitted into N equal intervals. The spacing between the 
adjacent nodes x i — x i _ 1 = h = -F is termed a grid step or simply step. 
The splitting points x i = ih constitute what is called the set of grid nodes 
LOfo = {aq = ih, i = 1, . .. , N — 1} and generate one possible grid on this 
segment (see Fig. 1): 


o-e-e-e-e-► 

x 0 = 0 x 2 ... x, ... x N = l x 

Figure 1. 

When the boundary points x 0 = 0 and x N = 1 are put together with 
the grid ui h , it will be denoted by ui h — {aq = ih, i = 0, 1,... , N — 1, N}. 

On the segment [0,1] we are working with a new function y }l (x i ) of 
the discrete argument instead of a given function y(x) of the continuous 
argument. The values of such a function are calculated at the grid nodes 
x i and the function itself depends on the step h as on the parameter. 

Example 2. An equidistant grid in a plane. We now consider a 
set of functions u(x,t) of two arguments in the rectangle V = {0 < x < 
1, 0 <t < T} and split up the segment [0,1] on the a:-axis and the segment 
[OjT 1 ] on the t- axis into N[ and N 2 parts with steps h = 1 /N\ and r = 
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T/N 2 , respectively. After that, we draw the straight lines parallel to the 
appropriate axes through the splitting points. The points of the intersection 
of those lines are adopted, as usual, as the nodes (x^tj), which constitute 
a widespread grid 

u hT = {( x i,tj) <E V} 

with steps h and r along the directions Ox and Ot, respectively (see Fig. 2). 


t 

T 


tj = jr 
















(x,,tj) 











0 1 h 


x t ~ Ih 


Figure 2. 

The nodes lying on one and the same straight line (horizontal or ver¬ 
tical), the distance between which is equal to the grid step (h or r), are 
called adjacent grid nodes. 

Example 3. A non-equidistant grid on a segment. The next example 
is devoted to the segment 0 < x < 1 with N subintervals without concern 
for how the points 0 < x 1 < x 2 < . . . < x N __ 1 < 1 will be chosen. The 

nodes {x it i = 0, . . . , N, x 0 = 0, x N = 1} constitute what is called a non- 

equidistant grid w A [0, 1]. The distance between the adjacent nodes, being 

a grid step, equals h t = x i — x i _ 1 and depends on the subscript i. Any 

distance of this type falls within the category of grid functions. The steps 
should satisfy the normalization condition /i; = 1 • 
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Example 4. A grid in a two-dimensional domain. Our final example 
is connected with a complex domain G in the plane x = (x x ,x 2 ) of rather 
complicated configuration with the boundary T. One way of proceeding is to 
subdivide into sets of rectangles by equally spaced grid lines parallel to 0x 2 

defined by x j ’ — i x h x , = 0, ±1, ±2,.. . , h x > 0, and equally spaced grid 

lines parallel to Oaq defined by x^ ’ = i 2 h 2 , i 2 = 0, ±1,±2,... ,h 2 > 0, 
as shown in Fig. 3. As a final result we obtain the grid with the nodes 
(ij h 1 ,i 2 h 2 ), i lt i 2 = 0,±1,±2,... in the plane (x 1 ,x 2 ). It seems clear 
that the lattice so constructed is equidistant in each of the directions Ox 1 
and Ox 2 . We are only interested in the representative grid nodes from the 
domain G = G + T, including the boundary T. The nodes (fj h 1 , i 2 h 2 ) 
inside G are called inner nodes and the notation u> h is used for the whole 
set of such nodal points. The points of the intersection of the straight lines 

x = ij /ij and x^' 2 ^ — /i 2 , i 1 , i 2 — 0, ±1, ±2,... 0, with the boundary 

T are known as boundary nodes. The set of all boundary nodes is denoted 
by -y h . In Fig. 3 the boundary and inner nodes are quoted with the marks 
* and o, respectively, 

As can readily be observed, there are boundary nodes with the dis¬ 
tance to the nearest inner nodes smaller than /ij or h 2 . In spite of the 
obvious fact that the grid in the plane is equidistant in aq and r, both, the 
grid ui h — uj h + -y h in the domain G is non-equidistant near the boundary, 
This case will be the subject of special investigations in Chapter 4. 

The approach we have described above depends for its success on 
replacing the domain G of the argument x by the grid uj h , that is, by a 
finite-dimensional set of points x i belonging to the domain G. The grid 
functions y(x i ) will be quite applicable in place of the functions u{x) of the 
continuous argument x £ G with x i being a node of the grid ui h = {sq}. 
Also, we may attempt the grid function y{x i ) in vector form. This is due 
to the fact that by enumerating the nodes in some order x 1 ,x 2! ... x N 
the values of the grid function at those nodes arrange themselves as the 
components of the vector 

y = (Vi, ■ ■ ■ ,Vi, ■ ■ ■ Vn) ■ 

If the domain G of forming the grid is finite, then so is the dimension 
N of the vector Y. In the case of an infinite domain G the grid consists of 
an infinite number of nodes and thereby Y becomes a.n infinite-dimensional 
vector. Within the framework of this book the sets of grids ui h depending 
on the step h as on the parameter will be given special investigation, so 
that the relevant grid functions y A (a:) will depend on the parameter h or on 
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Figure 3. 


the number N in the case of an equidistant grid. In dealing with various 
non-equidistant grids ui h we mean by step h the vector h = (h 1 , h 2 ,.. . , h N ) 
with components h 1 ,h 2 ,... , h N . 

The same observation remains valid with multidimensional domains 
G. Here x = (x 1 , x p ) and, on the same grounds, h = (/q, h 2 ,... , h p ) 

if the grid ui h is equidistant in each of the arguments aq,. . . , x p . 

Throughout the entire chapter, the functions u(x) of the continuous 
argument x £ G are the elements of some functional space Hq. The space 
Hh comprises all of the grid functions y h (x), providing a possibility to 
replace within the framework of the finite difference method the space H o 
by the space Hh of grid functions y h [x). Recall that although the fixed 
notation || • || is usually adopted, there is a wide variety of possible choices 
of the functional form of || • ||. 

In a common setting the set {Hh } of spaces of grid functions depending 
on the parameter h corresponds to the set of grids {w^}, making it possible 
to introduce in the vector space Hh the norm || • || A , which is a grid analog 
of the norm || • || 0 of the initial space Hq. We give below two norms in the 
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space Hh for the grids w h = [x { = ih } on the segment 0 < x < 1 . These 
norms are widely used in many applications to numerical analysis (here the 
subscript h of y h is omitted): 

(1) the grid analog of the norm on the space C: 

II y\\c = max \y(x) | or II V ||c = max. | Vi | ; 

0 <i<N 


(2) the grid analog of the norm on the space L 2 : 


N-l 

i/||= I E y\h 

7 = 1 


1/2 


N 


y\\ = E yf h 


1/2 


In what follows we will use, as a rule, several norms associated with 
inner products in the space Hh (the grid analogs of the L 2 and PV^-norms 
are available in Chapter 1). 

Given a solution u(x) of the original continuous problem, u £ H o, and 
a solution y h of the appropriate approximate (difference) problem, y h £ Hh, 
the main goal of the possible theory of approximate methods is the accurate 
account of the proximity between y h and u. It is worth noting here that in 
a common setting the vectors y h and u belong to different spaces. In this 
context, two interesting possibilities reduce to the following ones: 

• the grid function y h defined at the nodes co h (G) should be extended 
(for instance, via the linear interpolation) to all of the remaining 
points x of the domain G. As a final result we get a function y(x t h) 
of the continuous argument x £ G for which the difference y(x, h) — 
u(x) belongs to the space Hq. The proximity of y h to u is well- 
characterized by the number || y(x, /?,) — u(x) || Q , where || ■ || 0 is the 
norm of the space Hq\ 

• the space H o is mapped onto the space Hh, thereby putting every 
function u(x) £ Ho in correspondence with a grid function u h (x), 
x £ u>h, so that u h — Vh u £ Hh, where Vh is a linear operator 
from Hq into Hh- It is possible to establish this correspondence in 
a number of different ways by approval of different operators Vh- 
If u(x) is a continuous function, we might accept Uh{ x ) = u ( x ) f° r 
x £ u>h- Sometimes u h (x i ) is determined at a node x i £ ui h as the 
integral mean value of u(x) over some neighborhood of this node (for 
instance, of diameter 0(h)). In the sequel we will always assume 
that u(x) is a continuous function and keep u h (x i ) = u(x { ) for all 
x t £ ui h unless otherwise is explicitly stated. 
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For a difference function u h , we turn to the difference y h — u h , which 
gives a vector of the space Hh . The nearness of y h to u is well-characterized 
by the number || y h — u h || A , where || ■ || A is the norm of the space Hh- It 
seems natural to require that the norm || • || A should approximate the norm 
|| • || 0 in the following sense: for any vector u £ Hq 

IK Ik = IMIo- 

This condition is known as the condition of concordance of the norms 
on the spaces Hh and Hq. 

Under the second approach mentioned above we proceed to the accu¬ 
rate account of the errors of difference methods in the space of grid func¬ 
tions. In the most cases the spaces involved appear to be finite-dimensional. 

As we will see later, it is possible to present the principal aspects of the 
theory of difference schemes with further treatment of Hh as an abstract 
vector space of arbitrary dimension. 

After preliminary discussions of the simplest examples illustrating 
some ways of producing grids and, thereby, of forming the spaces Hh of 
grid functions we concentrate primarily on the problem of the difference 
approximation of differential operators. 

2. The difference approximation of elementary differential operators. Let 

a linear operator L assign the values to a function v = v{x). By replacing 
the derivatives built into Lv by their difference counterparts we derive the 
difference expression Lh v h , which is a linear combination of the values of 
the grid function v h on some set of grid nodes known as a pattern: 

Lhv h {x)= £ KfA.KK) 

££Patt(x) 

or 

{LhV}i)i — X] ^h{ x i) x j) v h{ x j) j 

Xj €Patt(xi ) 

where Ah(x, £) are the coefficients, h is a grid spacing and Patt(x) is a 
pattern at a point x. Any replacement of Lv by Lh v h is called the ap¬ 
proximation of a differential operator by a difference operator or 
the difference approximation of an operator L. 

The way this approach is used in practice is connected with prelimi¬ 
nary studies of difference approximations of the operator L locally, that is, 
at an arbitrary fixed point of the space. If v{x) is a continuous function, 
then v h {x) = v(x). Before giving further constructions of a difference ap¬ 
proximation of the operator L , it is necessary to choose a pattern of proper 
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form, that is, to compose the set of nodes adjacent to x at which the values 
of the grid function v{x) are aimed at approximating the operator L. 

In this section we consider several examples of difference approxima¬ 
tions for elementary differential operators. 

dv 

Example 1 Lv = —. Let us fix some point x on the Ox-axis by capturing 
. dx 

the neighboring points x — h and x + h, where h > 0, and try to approximate 
Lv. Also, it will be sensible to introduce the following expressions: 


( 1 ) 

( 2 ) 


_i_ v(x + h) — v(x) 

L h V = - 1 -— = v x , 

_ v ( x ) ~ v ( x ’ ~ h) 
L h v= - - h -= n 8 . 


Expressions (1) and (2) are called the right difference derivative 
and the left difference derivative and are denoted by v x and v x , respec¬ 
tively. The difference expressions L ^ and L“ are defined at two points. In 
other words, these are based on the two-point patterns x, x + h and x — h, 
x. Moreover, any linear combination of expressions (1)—(2) such as 

(3) L[ a) v = av £ + (! - a)v x , 


where a is a real number, can be adopted as the difference approximation 
of the derivative dv/dx. In particular, for u = 0.5 we get the central 
two-sided difference derivative 


(4) 


Vo 

X 


2 K- + Er) 


v(x + h) — v(x — h) 

2 Ji 


It turns out that there is an uncountable set of difference expressions ap¬ 
proximating Lv = v' and this is something one might expect. The following 
question is of significant importance: what is the error of one or another dif¬ 
ference approximation and how does the difference ip(x) = Lh v(x)— Lv(x) 
behave at a point x as h —>■ 0? The quantity ip{x) = Lh v{x) — Lv(x) refers 
to the error of the difference approximation to Lv at a point x. We 
next develop v{x) in the series by Taylor’s formula 


v(x ± h) = v(x) ±hv'(x) + 


ff_ 

y 


v"(x) + 0(h 3 ), 


assuming v(x) to be a sufficiently smooth function in some neighborhood 
(x — h 0 , x + h 0 ) of the point x and h < h 0) where the number h 0 is kept 
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fixed. Substituting the preceding series into (1), (2), and (4) yields 

v(x + h) - v(x) . h ... _., 2 . 

v x = -i- ^= v'{x) + - v"{x) + 0(h 2 ), 

v(x) — v(x — h) . h ... . 

(5) % = ^- = v (x)--v (x) + 0(h 2 ), 


= »(« + '■)_-»(» . -t) = Ax) + 0{h 2 } 


2 h 


thereby justifying that 


■0 = v x — v'(x) = 0(h) , 
tp = v x — v'(x) = 0(h) , 
ip = v o — = 0(h 2 ) 


Let V be a class of sufficiently smooth functions v £ V defined in a 
neighborhood Patt(x,ho) of a point x containing for h < h 0 the pattern 
Patt(x, h) of a difference operator Lh- We say that Lh approximates the 
differential operator L with order m > 0 at a point x if 


ip(x) = Lh,v(x) — Lv(x) = 0(h m ). 


Thus, the right and left difference derivatives generate approximations of 
order 1 to Lv — v 1 , while the central difference derivative approximates to 
the second order the same. 


Example 2 Lv = v" = -r-z. In order to construct a difference approxi- 

dx\ 

illation of the second derivative, it is necessary to rely on the three-point 
pattern (x — h,x,x + h). In that case we have 


( 6 ) 


L h v = 


v(x + h) — 2 v(x) + v(x — h) 

P 


Observe that the right difference derivative at a point x is identical 
with the left difference derivative at the point x + h, that is, the relation 
v x (x) = v s (x + h) occurs, permitting us to rewrite (6) as 


( 7 ) 


Lh v = 


v x ( x ) 


\ + h)~ iig(»] = v Sx (x). 
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With the aid of the expansion of the function v(x) in Taylor’s series it is 
not difficult to show that the order of approximation is equal to 2, meaning 
v Sx — v"(x) = 0(h 2 ) by virtue of the expansion 

(8) v xx — v" + — + 0(h 4 ) . 

Example 3 Lv ~ t/ 4 ). We now deal with the five-point pattern consisting 
of the points ( x — 2 h, x — h, x, x + h, x + 2 h) and accept LhV = v xxSx . By 
applying formula (6) to v Sx we derive the expression for v SxSx , which will 
be needed in the sequel: 

LhV = v xxxx = [v xx (x + h)~ 2 v xx (x) + v xx (x - h)\ 

= [u(x + 2 h) — 4 v(x + h) + 6 v{x) — 4 v(x — h) + v(x — 2 h)\ . 

It is straightforward to verify that Lh provides an approximation of order 
2 to L , so that v xxxx — t/ 4 ) = + 0(h A ). Indeed, this can be done 

using the expansion in Taylor’s series 


7 

v(x + akh) = v(x) + 

3 = 1 


(T S k S h s d S v(x) 
s ! dx s 


+ 0(h 8 ), 


a = ±1 , 


for k = 1,2 and exploiting the obvious fact that the sum v(x+kh)+v(x — kh) 
contains only even powers. 

The expansion of the approximation error ip = Lh v — Lv in powers 
of h is aimed at achieving the order of approximation as high as possible. 
Indeed, we might have 

v Sx - v " = y(4) + °( /l4 ) = jp> VsxSx + 0(yh ^' 

whence it follows that Lv — v" is approximated to fourth order by the 
operator 

K 2 

V r:r y2 'L'icr.r 

on the pattern (x — 2 h, x — h, x, x + h , x + 2 h). 

In principle one can continue further the process of raising the order 
of approximation further and achieve any order in the class of sufficiently 
smooth functions v £ V. During this process the pattern, that is, the total 
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number of the nodes will increase. However, the way of achieving a higher- 
order difference approximation we have described above is of little practical 
significance, since the quality of resulting operators becomes worse in the 
sense of computational volume, the conditions of existence for the inverse 
operator, stability, etc. Later in this chapter we will survey some devices 
that can be used to obtain higher orders. 

In the sequel an auxiliary lemma is needed. 


Lemma The formulae are valid: 


( 9 ) v.v 


v(x + h) — 2 v(x) + v(x 

h 2 



£ = x + 0h, |0|<1, 


if v G C^ 2 \x — h, x + h\, 


(10) Vfv = v "i x ) + ^ ' y(4) (0 , t,=x + O l h, Kl<i, 

if v G C^ 4 1[x — h,x + h\. Here C^ k ^[a t b] stands for the class of functions 
with the kth continuous derivative on the segment a < x < b. 


Proof We have occasion to use Taylor’s formula with the remainder term 
in integral form 


( 11 ) 


where 


( 12 ) 


(x ~ aV’ 

v(x) = v(a) + (x - a) v'(a) + • • • + 1——-(/’’) + R r+ i(x) , 

X 

R r+1 ( X ) = -( (,r-er^ +i )( o de 


i 

--p- / (1 — s) r u ( - r+1 l (a + s (x — a)) ds , 


o 

Applying Lagrange’s formula to the last integral reveals the remainder term 
R r+ i(x) to be 


(x — a) r+1 
(r + 1) ! 


« (r+1) (0, 


R ?+1 (•£) 
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where £ is the mean value of x on the segment [a,x]: 

l 

£ = a + 9 (x — a), 0 < (9 < 1, / (1— s) r ds = - . 

J r + 1 

o 

Upon substituting x + h for x and x for a into formula (11) we find that 

l 

(13) v(x + h) = v(x) + h v'(x) + h 2 J (1 — s) v"(x + sh) ds , 

o 

(14) v(x + h) = v(x) + h v'(x) + y v n (x) + y v n \x) 

l 

+ y J (1 — s) 3 + s/i) (is 

o 

for r — 1 and r = 3, respectively. Replacing here h by —h and then s by 
— s gives for later use the new formulae 

o 

(15) v(x — h) = v(x) — h v'(x) + h 2 J (1 + s) v"(x + sh) ds , 

-l 

(16) v(x — h) ~ v(x) — hv*(x) + — v n (x) —— v N, (x) 

^ o 

+ y J(l + s)*vV(x + 8h) ds . 

-l 

Adding (13) and (15), placing the term 2v(x) on the left and then dividing 
the resulting expression by /i 2 , we finally get 

l 

v(x + h) + v(x - h) - 2 v(x) f 
Vs* = --p-— = I 9 2 (s)v (x + sh ) ds , 

-1 


9 2 (s) 


1 + s for — 1 < s < 0 , 
1 — s for 0 < s < 1 , 


where 
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Since g 2 (s) > 0, Lagrange’s formula provides support for the representation 

l 

v S3; = v"(x + 6h) J g 2 (s) ds = v"(x + 6h) = v"(l ;), — 1 < 0 < 1 , 

-l 

where £ is the middle point of the segment [x — h, x + h\. The second formula 
(10) can be derived in the same manner as before. 

Below we follow these procedures in a step-by-step fashion: collect (14) 
and (16), carry 2v(x) over to the left-hand side and divide the resulting 
expression by h 2 , Simple algebra gives 

l 

h 2 f 

Vx X = v"(z) + y j ff 4 ( s ) v(4) ( x + sh ) ds , 

-l 

where 


J (1 + s) 3 for — 1 < s < 0 , 
\ (1 — s) 3 for 0 < s < 1 , 



1 

2 ' 


Because g i (s) > 0 and i/ 4 )(;r) is continuous, applying Lagrange’s formula 
yields 

v sx=v"( x ) + T‘~v (4 \x + 9h), |0|<1. 


Remark 1 By exactly the same reasoning as before, we can establish 

(! 7 ) v Sx = v "(x)+ ^ v(4 H x ) +-^ v (6 Xt) , t = x + 9h, 16 » | < 1 , 

if v(x) belongs to the class C^[x — h,x + h\. 


Remark 2 A similar result is still valid for the derivative 
(18) v SxSx = [u(x- + 2h) - 4 u(i’ + h) + 6 v(x) 

— 4 v(x — h) + v(x — 2h)\ ~ , 

where £ = x + 9h , |(9| < 2, is the middle point of the segment [x — 2 h,x + 2 h\ 
and v G C^[x — 2 h, x + 2 h]. This expression will be proved if we succeed 
in showing that 

2 

v-xxxx = 1 J d( s ) v^\x + sh) ds , 

-2 
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where 


' 8 (1 + 0.5s) 3 


for 

- 2 < s < -1 , 

8 (1 + 0.5 s) 3 - 

4(1 + s) 3 

for 

- 1 < s < 0 , 

8 (1 - 0.5s) 3 - 

4(1 - s) 3 

for 

0 < s < 1, 

. 8 (1 - 0.5s) 3 


for 

1 < s < 2. 


The reader is invited to do it on his/her own, 
dv d' 2 v 

Example 4 L v = — -— —^ v = v(x t). Let (x t) be a fixed point in 

at ox 2 

the plane (x,t) and let h > 0 and r > 0 be two arbitrary numbers taken 
as steps in the sequel, A difference approximation Lhr of the operator L is 
connected with a proper choice of the pattern. 

We begin by placing approximations of the simplest type for which 
the pattern consists of the four points (Fig, 4,a), so that Lh T is certainly 
expressed by 

(19) ^.)„ = »(»■< + 

v(x + h,t) — 2 v(x t t) + v(x — h,t) 

1 2 • 

A suitably chosen symbolism may symplify the form of writing various 
difference expressions and makes our exposition more transparent. This is 
acceptable if we agree to consider 


v = v(x,t) , v = v(x t t + r) , v = v(x t t — r ) , 

Within these notations, the difference derivative with respect to t becomes 

(20) v = V ^ X,t + T ) ~ V ( X,t ^ = ^ ~ v 

' 1 T T 

By virtue of relations (7) and (20) we write down (19) in the form 
(19') 


r (01 

l hT v = v t - v Sx 


In the preceding constructions of we have taken the value of Vg x at the 
moment t, that is, on the lower layer. On the pattern depicted in Fig, 4.b it 
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(x,t+r) (x — h,t + r) (xJ + t) (x + h,t + r 



(x — h,t) (,i’,f) (x + h,t) 


c 

Figure 4. 

is reasonable to place v xx at the moment t + r, that is, on the upper layer, 
so that 

(21) L^}v=v t -v Sx . 

By a linear combination of (19') and (21) we get a one-parameter family 
of difference operators on the six-point pattern shown in Fig. 4,c for <7 yl 0 
and (7^1: 

(22) L [ ° t ] v = v t - (a v Sx + (1 - cr) v gx ) . 

In the estimation of the order of approximation we substitute into the 
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formulae for L 


(o) 

hr 


y , 4V * and 4? 


v the following expressions; 


dv(x,t) t d 2 v(x,t) 


dt 

dv(x,t + t/2) , 
dt 


2 <9f 2 

+ 0(r 2 ), 


+ 0(r 2 ) 


d 2 v(x } t) h 2 d 4 v(x,t) 


+ l2 + 0{ ~ h ] 


dx 2 

d 2 v(x, t + t/2) t d 3 v(x,t + r/ 2) 

dx 2 2 dx 2 

_ d 2 v(x t t + t/2) t d 3 v(x t t + r/ 2) 

~ xx dx' 2 2 dx 2 dt 

The outcomes of such manipulations are: 


+ 0(h 2 + t 2 ) , 
+ 0(h 2 +T 2 ). 


(o) _ dv(x,t) d 2 v(x,t) | ^ /l2 


!) V = 


+ 0(h 2 + r) 


dx 2 

= Lv(x,t) + 0{h 2 + t) , 

meaning, '0*- 0 -* = 4V v ~ Lv(x,t) = 0(h 2 + r); 


2) = + 0(^ + 0 


= Lv(x,t + r) = 0(h 2 + r), 


meaning, ^t 1 ) = 4V v — Lv(x,t + r) = 0(h 2 + r); 

Ar 9t 9a; 2 

= Lu(x-, / + r/2) = 0(h 2 + r 2 ), 

meaning, i/*- 0 ' 5 ) = u — Lv(x,t + r/2) = 0(h 2 + r 2 ), 


All this enables us to conclude that the operator 4V P rov i des the approx¬ 
imation of order 2 with respect to h for any <r, the approximation of order 
1 with respect to r for <7 = 0 and <7 = 1, and the approximation of order 2 
with respect to r for <7 = 0,5, 
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Example 5 L v = - 7 -^- — - 77-^7 , In that case the values of a grid function at 
ot z ax z 

three instants of time t — r, t and t + r are aimed at selecting the difference 
operator Lhr- The five-point pattern plotted in Fig. 5.a,b,c is the best 
possible for our purposes. 


(x 


,t + r) (agf + r) (x + h,t + r) (x,t + r) 


(x,t) 


(x,t) 


(x, t — t) 


•-* - • 

(x — h,t — t) (xJ—t) (x + h,t — t) 


a 


b 


{x,t + r) 


(x — h^t + r) (x^t + r) (x + h^t + r) 

(x + h, t) 




(x — h, t) 

(x,t) 

(x — h, t) 

(x t t) (x + h,t) 




(x^t — r) (x — h,t — t ) ( x,t — r ) (x + h,t — T) 


Figure 5. 


One of the possible approximations on the pattern 5.c with using the 
value v Sx on the middle layer t is of the form 

( 33 ) LhT v = v it — V XX > 

where 

v(x,t + t) — 2 v(x,t) + v(x,t — t) 
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In a similar manner one can write down on the pattern 5.a the operator 


(24) L hT V = v u - v xx . 

On the other hand, a two-parameter family of difference operators 

(25) L ( h a T l,a2) v = v u - (o-j v Sx + (1 - o-j - cr 2 )v Sx + a 2 v Sx ) 

is based on the nine-point pattern 5.d, whence (23) follows for a 1 = a 2 = 0 
and (24) follows for a 2 = 0 and a 1 — 1. We have occasion to use the 
asymptotic formulae 


,2 v(x, t) 






dt 




d 2 v(x,t) 
dx 2 


+ 0(h 2 ), 


thereby justifying that operator (23) provides an approximation of 0(h 2 + 
t 2 ). Operator (25) has the same order of approximation for u l — u 2 = <7, 
where u is an arbitrary number. 

We note in passing that a key role of the parameters a 1 and a 2 just 
as the parameter a in the previous example is connected not only with the 
approximation order, but also with stability of the appropriate difference 
scheme, This important property will appear in subsequent discussions in 
Chapter 5, Section 1, 


Example 6. Lv = v". An irregular pattern (a non-equidistant grid). 
Granted two numbers /j_ > 0 and h+ > 0, other ideas are connected with 
the three-point pattern (x — h-,x,x + /i+). When h- yf h + , any such 
pattern is said to be irregular, since the grid including this pattern turns 
out to be non-equidistant. Being concerned with new members 

v(x) — v(x — h-) v(x + h + ) — v(x) /i_ + h + 

v s = — , v x = — , n = - , 

we refer to the operator L/ 1 with the values 

1 v(x + h + )-v(x) v{x)-v(x-h-) v x -v x 

(26) LhV = ii[ -s;- r - n~- 

For h- = h+ = h the preceding is identical with expression (7) (see Example 
2). Plain calculations of the local approximation error at a point x show 
that 


ip{x) - L h v(x) - Lv(x). 
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Having stipulated the condition h± < 2 ti, the well-established expansions 
of a sufficiently smooth function v{x) in a neighborhood of the node x such 
as 

h 2 h 3 

v(x + h + ) = v{x) + h + v'(x) + v"(x) + v'"(x) + 0(h\) , 

h ^ 

v(x — /j_) = v(x) — h- v (e) -|—~ v"(x) - - v"'(x) + O(ht ) 

lead to the following ones: 

V x - v '(x) + v "(a;) + v '»( x } + 0(h\ ) , 

% = v'(x) - ~ v"{x) + ^ v"'{x) + 0(hi), 

L h v = = v"{x) + ^ v"'{x) + 0(h 2 ). 

n bn 

With these relations in view, we derive the usefull expressions for ^(x) 

(27) ip - L h v — Lv = h+ ~ h ~ v'" + 0(h 2 ) = 0(H), 

o 

Thus, operator (26) provides the local approximation of order 1 on any 
irregular pattern with /j_ yf h + , 

3. The error of approximation on a grid. So far we have considered the 
local difference approximation; meaning the approximation at a point. Just 
in this sense we spoke about the order of approximation in the preceding 
section. Usually some estimates of the difference approximation order on 
the whole grid are needed in various constructions. 

In preparation for this, let ui h be a grid in a domain G of the Euclidean 
space {x = (Kj,. . . , £ p )}, Hji be a vector space of grid functions defined on 
the grid ui h and let the space Hq comprise all of the smooth functions v{x), 
whose norms are defined by || • || 0 and || • || ft , respectively. In the sequel 
we take for granted the following assumptions: 

(1) there exists an operator Vh such that Vh u = u h £ for any 
u £ H 0 \ 

(2) the norms || • || Q and || • || A are concordant, that is, 

! bm o || V h u || h = |H| 0 , 
where | h \ stands for the norm of a vector h. 
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The next step is to introduce an operator L in the space Hq and an 
operator Lh carrying a grid function v h into a grid function Lj l v h on the 
grid Lo h (L h : H h h-> H h ), 

A grid function 

iph = Lh v h — (Lv ) h , 

where v h = VhV, {Lv) h — Vh(Lv) and v is an arbitrary function (vector, 
element) of the space H o, is called the error of approximation of the 
operator L by the difference operator Lh- 

^ ll'^/ill/i — 5 - 0 as h —> 0, we say that the difference operator Lh 
approximates the differential operator L. 

Likewise, the difference operator Lh approximates the differential 
operator L with order m > 0 if 

(28) Hh\\ h = \\L h v h -(Lv) h \\ h = 0(\hn 

or || L), v h~(Lv) h ||j < M | h | m , where M is a positive constant independent 
of | h |. 

Remark 1 We give below several examples of projectors Vh onto the set 
of grid functions: 

(1) for a continuous function v(x) t v h = Vh v{x) = v(x), x £ ui h \ 

( 2 ) 

x-\-h 1 

v h = L’h v = ~ J v(t) dt=~J v(x + sh) ds 

x—h — 1 

if v{x) is a summable function, etc. 


Remark 2 The length \h \ = +• • •+ h^) 1 ! 2 of a vector h — (h l , .., , h p ) 

with components h 1 , ,. . , h p may be taken as the quantity involved in the 
above definitions. Observe that approximations with respect to h at a = 
1,2,,,, , p, may be different in order. If so, instead of (28) we might have 

\\L h V h - {Lv)h\\ h < M Y, K a ■■ m a > 0 • 

O-rrl 

Choosing among the numbers m lt ... , m p the minimal one and denoting it 
by m, we get estimate (28). 



70 


Basic Concepts of the Theory of Difference Schemes 


Remark 3 If the grid uj h is non-equidistant, that is, h = (/ij , . .. , h jV ), 
where N is the total number of nodes, it is sensible to deal with h = 
maxicicjv h { or the mean square value | h |. 

Several examples add interest and help in understanding the outlined 
theory. 


Example 1. The difference approximation on a non-equidistant 
grid. In working in the space H o = C^fO, 1] comprising all the functions 
defined on the segment 0 < x < 1 we refer to the operator L with the values 



and take on this segment an arbitrary non-equidistant grid 


w h = { x i, * = 0,1,..., AT, x 0 = 0, x N = 1} . 


On account of Example 6 in the preceding section the difference operator 


j T \ 1 (Vi+1 ~ V i 

{Lh v) *■ = h. - 

n l x n l +1 


v i - 

Jl: 


, n i = 


hj + h i+1 
2 


defined at the node x i on the irregular three-point pattern {x i _ l , x { , x i+1 ), 
is associated with the operator Lv. With this, we rewrite Lh v as 


(Lh v)i = v s£ii - v x . £ . 


with more compact notations 


hi 


_ V i + 1 ~V { _ V i + 1 - Vi 

1 — j, i Eiv — 


hi+i 


hi 


In Section 1,2 we have found the local approximation error taking now 
the form 


'^i = (Lh v)i - (Lv) l 


h ■ — h ■ 

n i -\-1 ll % 


f i " + 0(hf), ,N-1 


From here it is easily seen that the operator L/ t is of order 1 with respect 
to the grid norm of the space C: 


if\\ — max | ifi | = 0(h) , h= max /?.,■ , 


l<i<N-l 


l <i<N 
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The same is still valid in the grid norm of the space L 2 - 


' N -1 


1/2 


= E K Af = 0(h ), 


i = 1 


We claim that in an alternative norm known as the negative norm 

i 1/2 


l^ll(-i) = 


w-i / i 

EME hA) 

i- 1 = l y 


the local approximation error ip is of order 2 and behaves like 


(29) 


!!(_!) = 0(/i 2 ), /i= max/ 1 ,, 


l<i<W 


Indeed, rewriting ip as 


A = 


h 2 , — h f 

g + 1 1 -./// 


6 hj 


<' + 0(A) 


and taking into account that ?/" = + 0(/i J+1 ), we establish the decom¬ 

position 

**= 6/,. 8 . ? - + ^ = ^ + < 

0 

with i/i* = 0(h 2 ) in any suitable norm. The main term ip t in the established 
0 

decomposition ip i =ip i -\-ip* is of “divergent form”, thereby justifying that 


Si ~ h k ip k - y] 


1 hl.'V'JA-hlv"' h 2 ,, v'" - h 2 v'" 


k + 1 u k +1 'T _ 'b + 1 ”8 + 1 ' 'T ‘fi 


6 


6 


Since |Si| < M/i 2 , we find that 


/w-i 


1/2 


v- ii(_ n = =o(h 2 ), 


^ i — 1 


which in combination with the relations 

II V’ll ( _i) < II ^ ll(-i) + WA ll(-i). 


A !!(_!) = o(h 2 ) 
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implies that || ip ll(_i) < Mh 2 . This means that the approximation error is 
of order 2 in the negative norm || • ll^jy Observe that the norm || • 

is concordant with the norm ||ii|[ 0 = [Jq 1 dx(fj u (0 dP) 2 ] 112 , so that 

II u h ll ( _i) IMI 0 as h->0. 

Another conclusion can be drawn from this example. Of course, the 
study of the local approximation is unsufficient for determination of the 
order of the difference approximation and proper evaluation of the quality 
of a difference operator. 

In the estimation of the approximation error the well-founded choice 
of the norm depends on the structure of an operator and needs investigation 
in every particular case. A precise relationship between an operator and a 
norm in the process of searching the error of approximation will be estab¬ 
lished in the general case in Section 4. Its concretization for the example 
of interest leads naturally to the appearance of the negative norm || • ll^jy 
A similar obstacle occurs in trying to construct difference approximations 
of the operator L u = (k u ')', where k(x) is a piecewise continuous function 
(see Chapter 3). 

Where searching a solution u(x,t) to a nonstationary equation (for 
instance, to the heat conduction equation), it is not unreasonable to sepa¬ 
rate the variable t (the time). Some consensus of opinion is that the sought 
function u(x,t ) as a function of the argument x is an element of the space 
H 0 . Let ui h be a grid in a domain G of the space {x = (x 1 ,. . . , x p )} and let 
lo t be a grid on the segment 0 < t < t 0 . The grid function y(x, t) = Uh T (x, t) 
is defined on the grid ui hT = ui h x ui T = { (x, t ), x (zui h , y £ w T } and gives as 
a function of the argument i £ a vector of the space Hh with the norm 
|| • || ft . In dealing with y(x,t) on the grid ui hr many scientists generally 
prefer either 

(30) \\y\\ = max \\y(t)\\ 

ZtzlO r 

or one of the alternative norms 

(31) \\y\\ hT = E EIj/WIL- IML = ( E r lls/WIL 2 ) ' ■ 

t£iO r t£tO T 

Let Lhr v hr be a difference approximation of the operator Lu, where 
u = w(x, t). The operator i/ lT assigns really the values to the grid functions 
v flT (x,t) defined on the grid Lo hr . If v(x,t) as a function of the argument x 
belongs to the space Ho, then v h (x , t) = Vh v(x, t) £ Hh for any t £ [0, t 0 ]. 
For any continuous in t function v(x,t) and all t £ ui T , we put v hT (x,t) = 
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v h (x,t), thereby specifying v hT on the grid ui hT and reducing the error of 
approximation to 


i'h T {x,t) = L hT v hT (x,t) - (Lv) hT (x,t ), (x,t) G u hT . 

We say that Lh T approximates L with order m > 0 in x and with 
order n > 0 in t if in the class of sufficiently smooth functions v(x,t) one 
of the estimates 


II VU*. t) IL = 0(\h\ m + r n ), || ^ || At <M(\h\ m + r n ) 

is valid with a positive constant M independent of | h | and r both. 


Example 2 

dv d 2 v 

L n = — - ^ , 0 < x < 1 , 0 < t < t 0 , L hT v = v t - v Sx . 

The difference operator Lh T defined at all inner nodes of the grid 


^hr ~ { i x i ,tj)’ x i ~ ih . tj = jr, 0 < i < N, 0 < j < i 0 , j 0 = t 0 /r } 

complements subsequent studies and proves to be useful in many aspects. 
If v(x,t) possesses two derivatives with respect to t and four derivatives 
with respect to x (v G Cl) that are continuous in the rectangle {0 < x < 1, 
0 < t < t 0 }, then 

/n-OM) = L hT v hT - (Lv) hT = 0(h 2 + r) 


at each of the inner nodes of the grid ui hr . This is also consistent with 
the results of Section 1.2. Hence, Lh T approximates L to second order 
in x and first order in t in either of the norms (30) and (31), where 

\\ip\\ h = maxjg Uh \ ip \ or 11 0 11 = (Eill 1 i’f h ) ' . etc - Thus - in the 
case of interest the approximation on the grid follows from the local ap¬ 
proximation. 

So far we have studied the error of the difference approximation on the 
functions v from certain classes V. In particular, in the preceding examples 
the class of sufficiently smooth functions stands for V■ 

In what follows it is supposed that v = u is a solution of a differential 
equation, say 

Lu = u" = -f . 
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The meaning of Lh v — v Sx as the difference approximation of the operator 
L v — v" reveals that 

L h v = v" + — 1 / 4 ) + — v( 6 \x + eh ), -i<e<i. 

12 360 ' 7 - - 

We substitute here v = u, u" — — f, u = —f" and accept f" — 0, 
implying that = 0 for all k > 2. Then Lh u = u" = Lu, that is, 
the approximation error happens to be from the class of solutions to the 
equation Lu = —/, where / is a linear function identically equal to zero: 

= 0. In that case the approximmation is said to be exact. But if f" ^ 0, 
the accuracy will be improvable once we attempt the operator in the form 

~ h ^ 

L h v = L h v + — f" , 

thereby providing the approximation ijj = Lh u — Lu = 0(h 4 ). 

Thus, the accurate account of the error of the difference approximation 
on a solution of the differential equation helps raise the order of approxi¬ 
mation. 

4. The statement of a difference problem. In the preceding sections we were 
interested in approximate substitutions of difference operators for differen¬ 
tial ones. However, many problems of mathematical physics involve not 
only differential equations, but also the supplementary conditions (bound¬ 
ary and initial) which guide a proper choice of a unique solution from the 
collection of possible solutions. 

The complete posing of a difference problem necessitates specifying the 
difference analogs of those conditions in addition to the approximation of 
the governing differential equation. The set of difference equations approx¬ 
imating the differential equation in hand and the supplementary boundary 
and initial conditions constitute what is called a difference scheme. In 
order to clarify the essence of the matter, we give below several examples. 

Example 1. The Cauchy problem for an ordinary differential equa¬ 
tion: 

(32) u! = f(x ), x > 0, u(0) = u 0 . 

We proceed, as usual, on the simplest uniform grid u> h = {x i — ih, i = 
1,2,...} and put the difference problem 
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in correspondence with problem (32), Here the right-hand side can be 
specified in a number of different ways, for instance, by the formulae 


fi - f( x i), 


f( x i)+f( x i+ 1) 
fi = -b- 


provided the condition — / 8 - = 0(h) holds. 

Thus, given y 0 = u 0 , the solutions can be found from the recurrence 
relation y l+1 = y { + h <p { , i- 0,1,2. ... 


Example 2. The Cauchy problem for a system of first-order dif¬ 
ferential equations: 

du 

— Au — 0, t> 0, u(0) = u 0 , 

where A — (a ik ) is a square n X ?i-matrix and u — (u 1 , . ., , u n ) is an n- 
dimensional vector. As we will see later, it seems reasonable to introduce 
the grid ui T = {i • = jr, j = 0,1,2,,..} with step r. One of the possibilities 
is Euler’s difference scheme 

-- -^—+Ay J =0, j = 0,1,2,.,., y J -(y( ,y J 2 ,y ] n ) . 

The difference problem under consideration will be completely posed if the 
subsidiary information is available on the vector y 3 for j — 0 with the 
initial condition y° — u 0 . The value y^ +1 is successively calculated by the 
explicit formula 

yi + 1 — y J — tA . 

This is one way of gaining experience with Euler’s scheme that can be 
accepted and used in theory and practice. 


Example 3. The boundary-value problem: 

(33) u"(x) — —f( x ) , 0 < x < 1 , u(0) = p 1 , u(l) = /i 2 , 

We take once again the equidistant grid 

= { x i = ih, i = 0,1,.. . , TV, hN ~ 1} 
and set up on it the difference problem 


(33 h 


Vxx = 


or 


y j+1 -2 Vi -yj- L 

K 2 


= - fi 


i = 1,2,... , TV - 1 , i/ 0 =/H > Vn ~ f 2- 

Thus emerged the system of algebraic equations with a tridiagonal matrix. 
Because of this form, the elimination method may be useful (see Chapter 1, 
Section 1). 
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Example 4. The first boundary-value problem for the heat con¬ 
duction equation: 

du d ^ u 

(34) Lu= — - ^ = f(x,t) , 0 < x < 1 , 0 <t<t 0 , 

u(0, t) = , u(l, t) — p 2 {i) , u(x, 0) = u 0 (x). 

Choosing the equidistant grid u hT = {(aq = ih , tj = jr), i = 0, 1, . . . , N\, 
j = 0, 1,. . . , AC} and the simplest four-point pattern from Example 4 in 
Section 1.2, we are now in a position to set up the difference problem 

Vt = Vsx + f . 

which admits the index form 


-Vi y/-i-2y/+i// 

7 — = - i? - + 7 


1 < i < TVi - 1 


0 < j < N 2 - 1 


Vo - Ci ) > vk = c 2 (tj), y° = u 0 (x { ). 

Here the right-hand side ip can be defined in a number of different ways: 
P- = f( x i’tj) ’ Pi=f( x i,t j + 1 / 2 ). etc. 

The difference problem (34 h ) illustrates the implementation of the so-called 
explicit scheme in which the values of the solution on the upper layer 
y 3+1 are expressed through the values on the current layer by the explicit 
formulae 

yj+l =y J +T + IP J ) . 

Common practice involves also the implicit scheme 


yt=Vxx+P> y( x ,0) = u 0 (x) , xew h , 


2/(0, t) = /n(t) , y(l,t) - p 2 (t) , t<Ew T , 

which finds a wide range of applications. In order to have for later use the 
values y = y J + 1 G n the (j + l)th layer, we must solve by the elimination 
method the system of algebraic equations with a tridiagonal matrix 
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or 

Vi-i ~ (2 + ~r) y/ +1 + 1//+Y = - h 2 F/ , o < i < N , 

Vo +1 = Mi(^-+i). i/jv +1 = f^Oy+i) • 

So far we have considered the first kind boundary conditions approx¬ 
imated exactly on grids. In the case of the third kind boundary conditions 
the question of their approximation needs investigation. In the next section 
we will say a little more about this. 

5. Convergence and accuracy of schemes. While solving a problem by 
an approximate method the accuracy which is provided by this method 
should be properly evaluated and predicted before proceeding to further 
constructions. In this regard, the question of convergence and accuracy of 
difference schemes arises naturally. 

For convenience in analysis, we look for in a domain G with the bound¬ 
ary T a solution to the linear differential equation 

(35) Lu — f(x), x G G , 
subject to additional (boundary or initial) conditions 

(36) l u = n(x) , x G T , 

where f{x) and jj.(x) are given functions (the input data of the problem) 
and / is a linear differential operator, under the agreement that a solution 
of problem (35)—(36) exists and is unique. 

Within the framework of the present chapter the domain G + T of 
continuous variation of an argument (point) is replaced by some discrete 
set of points (nodes) x i known as a grid. 

Let h be a vector parameter related to the distribution density of the 
nodes of the grid and let ui h and j h be the sets of its inner and boundary 
nodes. With these ingredients, the difference problem 

(37) L h y h =<p h , x G u h , l h y h = x h for x £ j h , 

where fh{x) and X A (r) are given grid functions, is put in correspondence 
with problem (35)—(36). Here the operators Lh and l h assign the values to 
grid functions defined for x £ io h — ui h + y h . A solution y h of problem (37) 
is a grid function of the nodes of the grid ui h . Varying h and thereby com¬ 
posing different grids Q h , we constitute the set of solutions {y^} depending 
on the parameter h. In this context, the family of difference problems (37) 
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corresponding to different values of the parameter h is of great interest and 
refers to a difference scheme. 

The main goal of any approximate method is to solve an original 
(continuous) problem with a prescribed accuracy e > 0 in a finite number 
of operations. In order to clarify whether it is possible in principle to 
approximate a solution u of problem (35)—(36) by a solution y h of problem 

(37) with any prescribed accuracy e > 0 depending on the step h(e), we 
follow established practice. This is concerned with further comparison of 
y h with u(x) in the space of grid functions H; t . Let u h be a value of the 
function u(x) on the grid u> h , so that u h G Hh- The error z h = y h — u h of 
the difference scheme (37) needs more a detailed exploration for a complete 
and rigorous treatment. 

The condition for z h can be derived upon substituting y h — z h + u h 
into (37). Through such an analysis the problem of the same type arises as 
problem (37): 

(38) L h z h = ijj h , x G Lo h , l h z h = v h , x G J h , 

where ip h and v h are residuals equal to ip h = ip h — Lh u h and v h — x h — 4 u h- 
The right-hand sides tp h and v h of problem (38) are called the error of 
approximation of equation (35) by the difference equation (37) and the error 
of approximation of condition (36) by the difference condition l h y h = x h on 
a solution of problem (35)—(36) or, briefly, ijj h is the error of approximation 
for the equation Lh yh = fh on a solution u(x) to equation (35) and v h 
is the error of approximation for the condition l h y h = v, on a solution of 
problem (35)-(36). 

The accurate account of the error z h of a scheme as well as of the 
errors of approximations i> h and v h is carried out in suitable norms || • ||( lfc p 
|| • 11(2^) an d II ' ll( 3 h ) on s P ace of grid functions. 

We say that a solution of the difference problem (37) converges to a 
solution of problem (35)—(36) (scheme (37) is said to be convergent) if 

IK ll (u) = \\Vh ~ u h ll (u) —*■ 0 as IM-*-0 

or 

II z h ll(i fc ) = II p(\ ^ I) II i where p{\ h I) ^ 0 as I h \-> 0 . 

The difference scheme (37) is said to be convergent with the rate 0 (| h | n ) 
or is of the ?ith accuracy order (of accuracy 0( \ h | n )) if for all sufficiently 
small \ h\ < h 0 the inequality 

IK 11(1,) = IK -KI(U) <M\h\ n 
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holds with constant M > 0 independent of | h | and n > 0 both. 

We say the difference scheme (37) is of the nth approximation order 
if 

11^*11(2*) = 0(\h\ n ), IK 11(3,0 = 0(1 M n ). 

Denoting by f h and ( Lu) h the values of f(x) and Lu(x) on the grid ui h 
and taking into account that (/ — Lu) h = 0, we can rewrite ip h as 

'fh = {fh~ L h «/,) - (A - {Lu) h ) 

— {fh ~~ fh) + (( L u ) h - Lh U h ) 

thus rearranging the approximation error tp h of a scheme as a sum of the 

error of approximation ip^ = ip h — f h of the right-hand side and the error 
r 2 1 

of approximation ip^ J = ( Lu) h — Lh u h of the differential operator. 

Since ip h is the error of approximation in the class of solutions to 
a differential equation, the condition || ip h ||( 2fc ( = 0(\h\ n ) holds true if 

neither nor ip^ is of order n. An example in Section 1.3 confirms this 
statement. 

We now should raise the question; how does the accuracy order of 
a scheme depend on the approximation order on a solution? Because the 
error z h = y h — u h solves problem (38) with the right-hand side ip h (and v h ), 
the link between the order of accuracy and the order of approximation is 
stipulated by the character of dependence of the difference problem solution 
upon the right-hand side. Let z h depend on tp h and v h continuously and 
uniformly in h. In other words, if a scheme is stable, its order of accuracy 
coincides with the order of approximation. 

A rigorous definition of stability of a difference scheme will be formu¬ 
lated in the next section. The improvement of the approximation order for 
a difference scheme on a solution of a differential equation will be of great 
importance since the scientists wish the order to be as high as possible. 

6. The attainable order of approximation of a difference scheme. As we 

have stated in Section 2.3, the order of approximation to a differential 
operator on a solution of a differential equation can be made higher without 
enlarging a pattern. For convenience in analysis, we take into consideration 
only two different difference schemes which will be associated with problem 
(32) for u' = f(x) and t*(0) = u 0 . Our starting point is the difference 
scheme of the form 




Vo — u o • 



80 


Basic Concepts of the Theory of Difference Schemes 


At the next stage we look for the residual ip = u x — p on a solution u = u(x) 
to the equation u' = f(x). The traditional way of covering this is to develop 
Taylor’s series 


u(x + h) = u(x) + hu + u " + u'” + 0(h 4 ) 

with the forthcoming substitutions u' = /, u" — f , ... and further refer¬ 
ence to expansions 

IP = U' + ^ U" + ^ U 1 " - p + 0(h 3 ) 

= f( x ) ~ p( x ) + | u " + y + 0(h 3 ) 

= f( x ) ~~ p( x ) + 2 f'( x ) + u '" + 0{h 3 ) . 

Upon substituting ip — f(x) + ^ h f or p { — (/ + | h f x ). we obtain the 
scheme of order 2 on the solution u = u(x), thus demonstrating that the 
residual ip behaves like 0{h 2 ). 

By virtue of the relations 

u'" = f"=f sx + 0(h 2 ) 

and 

f' = f x ~lhf sx + 0(h 2 ) 

we find that 

i> = / + 2 fx - fxx + 0(/l 3 ) - P , 

thereby clarifying that the scheme y x — p with the right-hand side 

_ f ,h , r 

P J T 2 Js 22 

is of order 3 on the solution u = u(x) [if) — 0(h 3 )). 

For the boundary-value problem 

u" — q u = —f( x ) , 0 < x < 1 , 


u(0) = 0 , u(l) = 0 


q = const , 
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we focus our attention on the three-point difference scheme 

Vxx ~ dy = ~<p(x) , x = ih, i = 1,2, ... TV - 1 , y 0 = y N = 0 . 

We will show that its order of approximation on a solution u = u(x) can be 
made higher without enlarging a pattern under a proper choice of d and <p. 

For a solution u = u(x) of the original problem, the residual ip = 
u Sx — du + ip will be involved in the expansion 

u xx = u " + Y2 u< ' 4 ' 1 ^(^ 4 ) 

with regard to the equation u" = q u — f(x), permitting us to deduce that 

'<P = (q - d) U + (<p - f ) + ~ U (4) + 0(h 4 ) , 

thus causing the behaviour like 0{h 2 ) for d = q and ip = /. Substitution 
of = q"u — /" = q (q u — f) — f Sx + 0(h 2 ) into the formula for ip yields 


ip 


<P-f~ 


hl 

12 


{fix + ?/) 


d — 



u + 0(h 4 ). 


A higher-order approximation ip = 0{h 4 ) can be achieved on the solution 
u(x) of the initial equation by merely setting 

q 2 h 2 h 2 , , 

d - ? + > <P = / + {fa + ? /) • 

We now turn to the question of approximations of boundary and initial 
conditions on a solution of the original problem. This question is intimately 
connected with the statement of a difference problem. 

7. Approximations of boundary and initial conditions. From Section 2.5 
it seems clear that the accuracy of a scheme depends on the order of ap¬ 
proximation on a solution of the original problem. By an approximation we 
mean not only the equation itself, but also the supplementary (boundary 
and initial) conditions. 

In this section we give several examples of raising the order of approx¬ 
imation for boundary and initial conditions without upgrading a pattern. 
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Example 1. The third boundary-value pr'oblem for an ordinary 
second-order differential equation: 

q = const , 0 < x < 1 , 

«(1) = /D • 

On the equidistant grid Co h = {x { = ih, 0 < i < N} we may attempt the 
difference equation in the form 

(40) y Sx - qy= -ip 

with ip j = /(aq), where f(x) is a continuous function. 

At the point x = 1 the boundary condition is satisfied exactly: 

(41) 2 /( 1 ) = Vn = h 2 • 

Furthermore, we replace the first derivative u ; (0) by the first difference 
derivative y x 0 = (jq — y 0 )/h and impose the boundary condition at the 
point x — 0 such as 

(42) y x> o = ay 0 -p 1 or l h y = p 1 , 

where an operator l h is defined on the two-point pattern (0, h). Substituting 
here y = z + u, where u is a solution of problem (29), we establish for the 
error z the condition 

o = <7 Z 0 - iy l . 

where the error of approximation zq for the boundary condition on a solu¬ 
tion is equal to v l — qi 1 + u x 0 — uu 0 . 

Developing u(x) about the node x = 0 in Taylor’s series 

h 2 

u 1 = u 0 + h u ' Q + — u" + 0(h 3 ) , 


(39) 


dx 2 


- qu= -f(x) 


du( 0) 
dx 


= emz(0) - 


we find that 

(43) u x 0 = u' Q + | u" + 0(h 2 ) , 

v 1 = [ji 1 + t/(0) — (t u(0)] + 4 h u"(fi) + 0(h 2 ) 
= 4/zu"(0) + O(/z 2 ), 
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since p 1 + w ; (0) — a u(0) = 0. This provides support for the view that 
zq = 0(h). It is necessary to make some changes in condition (42) to 
achieve the order of approximation 0(h 2 ). This is due to the fact that 
u(x) is just the solution of the original problem (39). From the governing 
differential equation the value u"( 0) can be expressed by 

(44) u"(0) = gu(0)-/(0). 

Substitution of (44) into (43) yields 

(45) u x }0 ~^h(q u(0) - /(0)) = u'(0) + 0(h' 2 ), 

thereby justifying that the left-hand side of (45) approximates to second 
order the derivative u'(x ) at the point x = 0 on the solution to the equation 
u" - qu = -/. 

From here and (42) it follows that the approximation of the boundary 
condition 

(46) 24,0 = vVo ~ hi , h = a+hhq, jl 1 = p 1 + 4 h /(0), 

is of order 2 on a solution of problem (39). 

It is worth emphasizing here that we have succeeded in raising the 
order of approximation without enlarging the total number of grid nodes 
which will be needed in this connection for approximating the boundary 
condition. 

Example 2. The boundary-value problem for the heat conduction 
equation: 

du d 2 u 

Ik = dx 2 + ’ 0 < x < 1 , 0 <t<t 0 , 

(47) u(x, 0) = u 0 (x), 

= au(0,t) “ hi(t), u(l,t) = ■ 

ox 

On the grid ui hT arising from Section 2.1 it is simple to follow the explicit 
scheme of accuracy 0(h 2 + r): 


(48) 


Vt = Vsx + ‘P - 


y(x,0) = u 0 (x) , y(\,t) - /i 2 W . 
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where tp = ipf = f{x i ,tj). In giving the difference approximation of the 
same order for the boundary condition at the point x = 0 we have occasion 
to use 

_ du(0,t) h d 2 u(0,t ) 2 

dx + 2 dx 2 + } ' 

By having recourse to the heat conduction equation for i = 0we establish 
a precise relationship 


d 2 u(0,t) du(0,t) 


~f(0,t ) ; 


which implies that 




The expression on the left-hand side of this equality approximates the de¬ 
rivative du/dx for x = 0 to 0(h 2 ). Replacing |y| r _ 0 by the appropriate 
difference derivative 

u(0, t + t) — u(0, t) 

u t, o = 

’ r 

we impose the difference boundary condition at the point x = 0: 

(49) Vx.o = \ h Vtfi + a Vo ~ f l i , = Mi + \ , 

whose approximation on a solution of problem (47) is of accuracy 0(h + T 2 ). 
In the case of the implicit scheme y t = y Sv + <p the following condition is 
acceptable to be an alternative: 

(50) y x>0 - | hy t 0 + a y 0 - fi 1 , p 1 = p, + | h /(0, t) . 

Example 3. The second-order hyperbolic equation: 

O^u O^u 

(51) — - — + f(x,t ), 0 < x < 1 , 0 < f < f 0 , 

u(0, t) = u 1 (t) , u(l, t) ~ u 2 (t) , 

u(x,0) = U 0 (x) , = ^o(x) ■ 
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Evidently, a special attention in approximating problem (51) is being 
paid to the difference form of writing the initial condition for the derivative 
du/dt. On any equidistant in x and t grid oj hT with steps h and r (see 
Section 2.1) the simplest approximation u t (a:,0) = u 0 (x) gives the error of 
approximation O(t). Plain calculations show that 

<.,(!, 0 ) = 


du(x, 0) r d 2 x(x,0) 2 

~^r~ + 2 —w~ + 0(T 


From the governing differential equation it follows that 
d 2 u(x, 0) d 2 u(x, 0) 


dt 2 
L u n 


dx 2 
d 2 u n 


+ f(x, 0) = Lu 0 (x) + f(x, 0), 


dx 2 


This is due to the fact that 

d 2 u(x, 0) d 2 u 0 (x) 

dx 2 dx 2 


In this line, 


u t (x,0) - \ t(Lu 0 + f(x, 0)) = du ^ ^ + 0(t 2 ) . 

Therefore, the difference initial condition y t (x, 0) = where 

u 0 (x) = u(x) + ~ t(L u 0 + f(x, 0)) , 

approximates to second order in r the condition du(x, 0 )/dt = u 0 (x) on the 
solution of problem (41). 

In this case the condition u(x, 0) = u 0 (x) and the boundary condi¬ 
tions are approximated exactly. For instance, one of the schemes arising in 
Section 1.2 is good enough for the difference approximation of the initial 
equation. No doubt, we preassumed not only the existence and continuity 
of the derivatives involved in the equation on the boundary of the domain 
in view (at x = 0 or t = 0), but also the existence and boundedness of 
the third derivatives of a solution for raising the order of approximation of 
boundary and initial conditions. 
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Example 4. The three-layer difference scheme for the heat con¬ 
duction equation. A special attention is being paid to the first boundary- 
value problem 

fj'll r) 2 u 

(52) — = + f(x,t), 0 < x < 1 , 0 <t<t 0 , 

«(0, t) = u^t) , u(l, t) = u 2 (t) , u(x, 0) = u 0 (x) . 

The usual practice in numerical analysis of the heat conduction equa¬ 
tion (52) is connected with three-layer schemes. The values y 3 ~ 1 (x), y 3 (x) 
and y 3+1 (x) of a grid function on the three time layers tj_ l , tj and tj +1 
are aimed at constructing such schemes. 

The three-layer symmetric scheme on the equidistant grid u> hT with 
steps h and r, being the most familiar one, comes first: 



y° = u 0 ( x i) , Vo = u l > Vn = u 2 ’ 

where A y = y Sx , a is a real parameter and ip 3 = f(x it tj). 

Since the central difference derivative in t approximates to the sec¬ 
ond order in r | i _ i and A« = + 0(h 2 ), scheme (53) approximates 

equation (52) with accuracy 0(h 2 + r 2 ). From what has been said above 
it is clear that problem (53) is overdetermined as it were. Applications 
of the three-layer scheme concerned necessitate imposing one more initial 
condition, for instance, by doing this on the first layer. But under such a 
condition the approximation 0(r 2 + h 2 ) should remain unchanged. There 
seem to be at least two ways of determining y(x, r). One way of proceeding 
is to approve at the first step the two-layer scheme of accuracy 0(r 2 + h 2 ) 
in specifying y(x, r): 

r 2 

Under the second approach the value of y(x,r) arranges itself as a sum 
y(x, t ) = u 0 (x) + r/i(x) and p is so chosen as to obtain the error y(x, r) — 
u(x,t), not exceeding 0(r 2 + /i 2 ). Substitution of the value |jy| , arising 
from the differential equation 


du 

dt t—0 


L u 0 + f(x, 0), 


d?u 0 

dx 2 
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into the formula 


u(x,t) - u 0 (x) = r ^ 


t 2 d 2 u 
t=o + ~2~ dt 2 


t~ o 


+ 0(r 3 ) 


yields fi = L u 0 + f(x, 0), so that 

y(x,r) = u 0 (x) + r (u"(x) + f(x, 0)) . 


2.3 STABILITY OF A DIFFERENCE SCHEME 

1. Examples of stable and unstable difference schemes. As we have shown 
in the preceding section, the introduction of a difference scheme permits one 
to reduce the solution of a problem associated with a differential equation to 
a system of linear algebraic equations. In this situation the right-hand sides 
of equations, boundary and initial conditions, all of which we will call in the 
sequel the input data, are specified with a certain error. This procedure 
causes rounding errors to be inevitable in the process of numerical solution 
of a system. Because of this, it seems natural to require that small errors 
in specifying the input data should not increase during the process of the 
execution and result in wrong reasoning. The schemes in which initial errors 
grow during the course of calculations turn out to be unstable and, from 
the viewpoint of possible applications, cannot find response. 

We will not attempt to encompass a wide variety of situations, but in¬ 
stead look in more detail at several exhaustive examples before formulating 
the definition of stability of a difference scheme with respect to the input 
data, the concept of which we have intuitively developed earlier. 

Example 1. A stable scheme. Let 

(1) u! = —a u , x > 0 , «(0) ~ u 0 , a > 0 . 

It is straightforward to verify that the function u(x) — u 0 exp { — ax} 
gives the exact solution of problem (1). This solution does not increase with 
increasing x: | u{x) | < | u 0 | for a > 0, so that u(x) continuously depends 
on u 0 . An excellent start in this direction is to approximate problem (1) on 
the equidistant grid u> h = {aq = ih, * = 0,1,...} by the difference problem 

(2) Vi ~^~ l +ay i = 0, y 0 = u 0 , i= 1,2,..., 
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which can be rewritten as 

y t = s y i _ 1 , s = 1 , i — 1 , 2 ,... , y 0 =u 0 , 

1 + an 

yielding y { = s l y 0 . 

We regard a point x to be fixed and take a sequence of steps h so 
that x would always belong the set of grid nodes: x = i 0 h. The attached 
number i 0 may be made arbitrarily large once we will refine the grid in any 
convenient way, that is, letting h —>■ 0. The value of y at this point becomes 

y(x) = 2/t 0 = s ’ 0 Vo ■ 

Since | s | < 1 for a > 0 and any h, we thus have 

I !/(*) I < I s | io | y 0 | < | 2 /( 0 ) | 


for any h. 

The last inequality implies that the solution of the difference problem 
(2) continuously depends on the input data. In such cases we say that a 
difference scheme is stable with respect to the input data. 


Example 2. An unstable scheme. For problem (1) we rely on the 


scheme 

£2 

1 

1 ’ 

+ 

1 

(3) 

n 


is 

li 

s? 

o 

S 

II 


Vi+i ~ 2 h 


+ « 2 // = 0 , 


i- 1,2,... 




where a > 1 is a numerical parameter. Observe that this scheme is a three- 
point one, since the difference equation is of order 2, so there is some reason 
to assign the value y x in addition to the value y 0 . The approximation order 
of scheme (3) is no less than 1 regardless of the choice of the parameter a. 
With u 0 = (1 — ah)u 0 , a proper evaluation of the deviation gives u — u{h) = 
0(h 2 ). We look for particular solutions to the difference equation (3) in 
the form y ( = s 1 . Substituting y^ — s 1 into (3) gives the quadratic equation 
related to an unknown s: 


(4) (<7 — 1) s 2 — (2 a — 1 + ah) s + a = 0 , 

which possesses two distinct roots 

2 a — 1 + ah ± \/l + 2 (2a — 1) ah + a 2 h 2 
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It is well-known that the general solution to equation (3) is of the form 

(5) yi =Asi+Bsi. 

Putting i — 0 and i = 1 and using the assigned values y 0 = u 0 and y l = w 0 , 
it is easy to calculate the constants A and B: 


A 


u n s 2 u n 


B 


S 1 u 0 


S | s 0 


It is clear that Sj s 2 > 1, since a > a — 1 > 0. We claim that s 2 < 1 
for any value of ah. Indeed, for a > 1 


2 (<t - 1) - (2<r - 1 + ah - n/1 + 2(2<t- 1 )ah+a 2 h 2 ) 


= \/(l + ah) 2 + 4(<j — 1) ah — (1 + ah) > 0. 

Let us stress also that s 1 > 1 for any value of ah on account of the bound 
Sj s 2 > 1 in view. 

From the well-established representation y i = As* + B s 1 it is easily 
seen that y i —»• oo as i —»• oo if A ^ 0. But we can always select y 1 = u 0 
so that the condition A = 0 holds true for the choice u 0 = u 0 s 2 . The 
rounding errors arise inevitably in developing the solution s*, thus causing 
the instability of the indicated type. In this scheme the solution increases 
along with increasing x. t = ih if h is kept fixed. Successive grid refinement, 
that is, successive refinement of h, leads to the growth of errors at a fixed 
point x = i 0 h, since i 0 = xjh increases along with decreasing h. A small 
change of input data results in an enormous change in the solution of the 
problem at any fixed point x as h —»• 0. 

We quote below the results of computations for problem (3) with 
y 0 = 1 and y 1 = s 2 , where s 2 is the smallest root to the quadratic equation 
(4). Once supplemented with those initial conditions, the exact solution of 
problem (3) takes the form y t — Bs 1 (A = 0). Because of rounding errors, 
the first summand emerged in formula (5). This member increases along 
with increasing i, thus causing abnormal termination in computational pro¬ 
cedures. 

Modern computers allow the implementation of model problems. We 
have carried out the calculations for several variants: 


1) 

a = 1.1, 

ah 

= 0.01, 

Sj = 11.11, 

s 2 = 0.99; 

2) 

a — 1.1, 

ah 

= 0.1, 

Sj = 12.09, 

s 2 = 0.91; 

3) 

7 = 2, 

ah 

o 

o 

li 

Sj = 2.02, 

.s 2 = 0.99; 

4) 

7 = 2, 

ah 

= 0.1, 

Sj = 2.17, 

s 2 = 0.92. 
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Table 1 contains the values j/j at several nodes of the grid ui h for the four 
variants. In the final line of this table the numbers of grid nodes connected 
with abnormal termination are indicated by “infinitiy”. 

Table 1 


Variant 1 

Variant 2 

Variant 3 

Variant 4 

% 

Vi 

i 

Vi 

i 

Vi 

i 

Vi 

6 

0.952 

7 

0.567 

32 

0.724 

28 

8.97 • 10“ 2 

7 

0.942 

8 

0.516 

33 

0.703 

29 

7.87 ■ 10 -2 

11 

0.900 

10 

0.420 

37 

0.260 

32 

3.78 • 10“ 3 

12 

0.832 

11 

0.306 

38 

-0.196 

33 

-7.41 -10- 2 

13 

0.174 

12 

-0.641 

39 

-1.11 

34 

-0.237 

14 

—7.05 

13 

—1.17 • 10 1 

40 

-2.95 

40 

—3.17 ■ 10 1 

15 

1 

oo 

Vi 

to 

o 

14 

-1.45-10 2 

50 

CO 

o 

o 

V 

1 

50 

o 

oo 

V 

1 

16 

-9.77-10 2 

15 

—1.76 • 10 3 

60 

-4.64-10 6 

60 

—1.94 • 10 s 

20 

—1.49 • 10 7 

20 

—4.54 • 10 s 

80 

—5.92 • 10 12 

80 

—1.19 • 10 15 

25 

-2.52 -10 12 

25 

—1.17 • 10 14 

90 

-6.69-10 15 

90 

-2.94-10 18 

32 

OO 

30 

OO 

100 

oo 
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2. The Cauchy problem for a system of differential equations of first order. 
Stability condition for Euler’s scheme. We illustrate those ideas with 
concern of the Cauchy problem for the system of differential equations of 
first order 


(6) — + Au = 0, t> 0, u(0) = u o , 

where u = (V 1 ), w*- 2 ), . . . , «(")) is the vector of unknowns, u 0 = (wo^, 

. .. , wl"' 1 ) is an n-dimensional given vector and A = (a^) is a symmetric 
positive definite nxn-matrix. In what follows a vector space H n is equipped 
with the inner product (u,v) = ]P? =1 and associated norm ||u|| = 

\J (u, u). Under these structures, a linear self-adjoint operator A: H n h—> 
H n , A = A* > 0, is associated with the matrix A of interest. 

We denote by {A^.,0} the system of eigenvalues and orthonormal 
eigenvectors of the operator A: 


^ k A k ^ k i 


k = 1,2,. .. , n 
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so that 


0<A 1 <A 2 < <A„, (ik,i,) = 6 k ,= 


1 , k — s , 
0 , k ^ s . 


With these entries, we look for a solution of problem (6) in the form 

n 

U W = E . 

5 = 1 

Substitution of this expression into equation (6) yields 

^(eT + As " s ) ~ 0, 


which implies that 


-^+ X k a k = 0, a k (t) = a k (0) exp {-\ k t} , k = l,2,...,n, 
providing the same grounds for the series 


u(0 = E a*(0) exp{-A fc f}^. 

k = 1 


Under the initial condition 


u(0) = u 0 = £ MOKfc 

k = 1 


we arrive at the relations 


a E°) = (u 0 ,$k) 


|u 0 || 2 = E E(o). 


From (7) it follows that 


I u 00 II 2 = Yj Y a E°) » s (0) exp {-X k t} exp {-A, t} (£ fc , £ s ) 


= Y a ik( 0 ) exp{-2A fc t} < exp{-2A 1 f} ^ a 2 (0) 


exp {—2 Aj t) || u 0 


2 
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which implies that 

(8) l|u(f)|| < exp { —i} || u 0 1| 2 . 

From such reasoning it seems clear that the solution of the Cauchy problem 
decreases along with increasing t: 

(9) l|u(f)|| < 11 u 0 11 for f>0. 

Of special interest is Euler’s scheme for the Cauchy problem 

(10) - — + Ay j =0, j = 0,1,..., y 0 = u 0 , 

where y ■ = y(^) and tj = jr. We seek its solution as a sum 

n 

( n ) Yj - E a k q 3 k ik, 

k = 1 

so that y 0 = u 0 = Y^k=i a k £k an d a k = ( u o > £k)- We note in passing that 
expression (11) satisfies equation (10) only if 

^ a k ^ ^ k ) ® 

k= 1 

or, what amounts to the same, 


It follows from the foregoing that q k = 1 — rX k . 

By rearranging the norm as 

n 

Hi/,' II 2 = E I?* ?a 2 k 

k = 1 

it is easy to derive the chain of the relations 

n 

II Yi II 2 < max | q > | 2 £ a\ = max | g 2 | 2 || y 0 || 2 < || y 0 || 2 , 

k k = 1 k 

which are valid under the conditions maxi | q k | < 1 and || y^ || 2 > || y 0 || 2 if 
min* | q k | > 1. Being an alternative of (9), the inequality 


(12) 


Yj II < II y 0 
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expresses the stability of the problem (10) solution. 

The condition max* | q k | < 1 is fulfilled if — 1 < q k = 1 — rX k < 1, 
that is, rA fc < 2 for all k = 1,2, .. . , n. For the latter to hold, it is sufficient 
that 


(13) 


T < 


2 

A ’ 


where A = max*, X k = X n . 

By a rather similar argument we take y 0 = c £ n , leaving us with a k = 0 
for k = 1,2,. .. , n — 1, a n = c and the relations 


Yj = C( ln£n =<l 3 n Y 0 , 11^11 = K I J 11 Yo 11 > 11 Yo 11 , 

since \q n \ = t X n — 1 = rA — 1 > 1 if r A > 2. For instance, when 
rA = 2 + p, p > 0, we draw the conclusions that | q n \ = 1 +p and 
| q 3 | = (1 + p) 3 oo as j —> oo. In that case scheme (10) becomes 
unstable and makes the method so inefficient as to be unusable. 

In mastering the difficulties involved, we impose the initial condition 
y 0 = c£j, thereby providing 


Yj = ?/ y 0 1 II yy II = l?i l J II y 0 II - 

where = 1 — tX 1 . 

It may happen that r > 2/A, but r Aj < 2 and | q l \ < 1, which assures 
us of the validity of the estimate 


( 14 ) IIyj II < \ f h \ 3 y 0 < || y 0 II • 

Because of rounding errors, y 0 is determined with some error e still subject 
to the approved decomposition 

n 

e S ik i e k ( e i ik) ’ 

k = l 

which is not surprising. No matter how the value e n is chosen, there always 
exists j 0 such that |e n ||? n j j0 > M 00) where M TC is computer infinity, 
meaning that for j = j 0 abnormal termination occurs because \q n \ > 1. 
Thus, scheme (10) turns out to be unstable with respect to rounding errors 
under any initial condition in the case where r A > 2. 

For the solution y - of problem (10), the requirement of having an 
estimate similar to inequality (8) necessitates imposing one more condition 
1 — rAj > rX n — 1 or, what amounts to the same, 

2 

r < A-r~ • 

Aj + A n 



94 


Basic Concepts of the Theory of Difference Schemes 


Assuming this to be the case, we deduce in light of the obvious relations 
1 — r Aj < exp { —Aj r} and | | > | q k | for k > 1 that 

II Yj II < max \<lk\ 3 II Yo II < (1 - T \) 3 II Yo II < {~\ tj } ||y 0 II ■ 

We have here one of many examples reinforcing the view that the 
general ideas of stability are sensible. Consider a system of two equations 

du dv 

-b au + bv — 0 , — + bu + av = 0 

dt dt 

with the matrix A = ^ ^, where a — ~ (A + 5) and b = A (A — 6). It 

is straightforward to verify that its eigenvalues and eigenvectors are equal 
to 

Aj=<S, A 2 = A, £i = (t2’ - 72)’ ^ 2 = (t2’72)- 

With these entries, scheme (10) reduces to 


(15) 


Vj+i - yj 

T 

z j+i ~ z j 


+ a yj +b zj =0 


i = 0,1,2,... 


+ b Uj + a Zj = 0 . 


Observe that the vector {y 0 , z 0 } coincides with the first eigenvector if we 
agree to consider 


( 16 ) Vo ~ yj > z o ~ ■ 

After scrutinising the available information we initiate the review of final 
results of calculations for problem (15)—(16) with the following values of 
parameters: 


1) 

II 

A = 2, 

II 

>| W 

2) 

o 

II 

A = 400, 

II 

>1 


In both cases | 1 — t6 \ < 1 and, therefore, for a solution of problem 
(15)—(16) estimate (14) is valid, but r > 2/A. Because of rounding errors, 
the computational process is unstable: for large j the growth of its solution 
causes abnormal termination in the computer realization of the algorithm. 

The final results of calculations are tabulated in Table 2 with the 
values of the functions y - and Zj for several j. For variants 1 and 2 abnormal 
terminations have occurred at the 105th and 46th time steps, respectively. 
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Table 2 


Variant 1 

Variant 2 

J 

Vi 

z j 

j 

yj 

Z 3 

8 

—5.52 • 10 '" 3 

5.52 • 10 “ 3 

8 

0.227 

0.227 

9 

2.76 • 10 “ 3 

-2.76-lO” 3 

8 

0.193 

-0.193 

10 

-1.38-lO” 3 

1.38 • 10 “ 3 

10 

0.164 

-0.164 

17 

1.08 • 10“ 5 

-1.08-10- 5 

13 

0.101 

- 0.101 

18 

—5.46 • lO '" 6 

5.33 • 10 “ 6 

14 

8.49 ■ 10 - 2 

-8.61 • 10“ 2 

19 

2.82 • 10 -6 

—2.57 • 10 ~ 6 

15 

7.56 • 10 “ 2 

—6.96 • 10 “ 2 

20 

-1.60 - 10- 6 

1.09 ■ 10 -6 

16 

4.69 • 10 “ 2 

—7.65 • 10 “ 2 

25 

8.18 • 10“ 6 

8.10 • 10“ 6 

17 

0.127 

2.16-10“ 2 

26 

-1.63 -lO ” 5 

-1.62 lO ” 5 

18 

-0.326 

-0.415 

27 *) 

3.26 • 10 “ 6 


19 

1.89 

1.81 

28 

-6.51 - lO ” 5 


20 

-9.23 

-9.30 

30 

-2.60-lO” 4 


2 i*) 

4.63 • 10 1 


50 

-2.73 -10 2 


22 

-2.32 -10 2 


68 

-7.16 -10 7 


38 

-3.53-10 13 


69 

1.43 -10 8 


39 

1.77 • 10 14 


70 

- 2 . 86 - 10 8 


40 

-8.83-10 14 


105 

OO 


46 

OO 


Once started with this number j we have Zj = yj . 


Observe that in variant 1 the accuracy in specifying the first eigenvec¬ 
tor is of significant importance. For the values 

(17) Vo = 1 , z 0 = -l, 

abnormal termination occurred at the 197th time step. At the beginning 
the variables i/j and Zj continue down to some quantities of order 10“ 19 for 
j k, 65-70 and then begin to grow. Unlike this tendency, the initial data 
(17) did not change essentially the results of computations for variant 2: 
abnormal termination occurred for j = 47. 

If for 6 = 1 and A = 2 we could take the value r = 2.1/A, for which 
the condition r < — is slightly violated (r is exceeded by 5%), the same 
still holds at the 760-790th time steps. 

The preceding examples provide enough reason to conclude that the 
concept of stability with respect to the input data is identical with the con¬ 
cept of continuous dependence of the solution of a difference problem upon 
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the input data. The two major aims, improved accuracy and better stabil¬ 
ity, have to be balanced against the need to avoid expending unnecessary 
computational effort. In the next few sections the advanced theory in such 
matters will be developed and presented in full details. 

3. On the concept of well-posedness for a difference problem. There is 
another matter which is one of some interest. In conformity with statements 
of problems of mathematical physics, it is fairly common to call a problem 
well-posed if the following conditions are satisfied: 

(1) the problem is uniquely solvable for any input data from some class; 

(2) a solution of the problem continuously depends on the input data. 
Being concerned with a solution y h and input data <p h of a difference 

problem depending on the grid step h as the parameter, we introduce the 
concept of well-posedness for a difference problem in a similar manner. 
Varying h we are in possession of two sequences of solutions { y h } and 
input data {<Ph}, thus causing not only a single difference problem, but 
also a family of problems depending on the parameter h. The concept of 
well-posedness is introduced for a family of difference problems (schemes) 
as | h | —> 0 . 

We say that a difference problem (scheme) is well-posed if for all 
sufficiently small \h \ < h 0 

(1) a solution y h of the difference problem exists and is unique for all 
input data ip h from some family; 

(2) the solution y h continuously depends on ip h and this dependence is 
uniform in h. 

More precisely, the second condition implies that there exists a con¬ 
stant M > 0 independent of h such as for sufficiently small | h | < h 0 the 
inequality 

(!8) II Vh ~ Vh ll (u) < M II <Ph ~ Vh 11(2,0 

holds, where y h is the solution of the problem with the input data <p ht and 
|| • ||( lf o an d || ' ll( 2 ,o are suitable norms on the set of grid functions given 
on the grid ui h . 

The property of the continuous dependence of the solution for a dif¬ 
ference problem on the input data is expressed by inequality (18) and is 
treated as the stability of the scheme with respect to the input data or 
simply stability (see Section 4.2) 

4. Stability, approximation and convergence. We now examine a continu¬ 
ous problem of the type 

(19) Lu = f(x) for ieG, 


/ u — ji{x) for iff 
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which is approximated on a grid ui h = ui h + j h by a difference problem 

(20) L h y h = tp h for x G , l h y h = hi for x e J h . 

The statement of the problem for the error z h = y h — u h , where u h is 
the projection of the solution u of problem (19) onto the grid u> ht is 

(21) L h z h = ip h for iEwj, l h z h ~ v h for x G J h , 

where ip h and v h are the errors of approximation to the governing equation 
and the additional condition. Instead of (21) we may write down formally 

Lh z h =^h- 

If the operator Lh is linear and the difference scheme is well-posed, we are 
led by (18) to 

\\ z h ll (u) < M \\i>h IU) or 

(22) 

II z h 11 ( 1 ,,) ^ M (|| 1p h ||^ 2k j + II V h ||(3^) ■ 

With these relations established, we conclude that if the scheme is stable 
and approximates the original problem, then it is convergent. In other 
words, “convergence follows from approximation and stability” and the 
order of accuracy and the rate of convergence are connected with the order 
of approximation. 

Everything just said means that in establishing convergence and in 
determining the order of accuracy of a scheme it is necessary to evaluate 
the error of approximation, discover stability and then derive estimates of 
the form (22) known as a priori estimates. 

Being the elements of different spaces, the solution z h and the right- 
hand side ip h of the difference problem should be evaluated in different 
norms. 

The examples of suitable norms are available in the preceding sec¬ 
tions in which the errors of solutions and approximations on the grid ui h 
are investigated in the usual way. Unfortunately, it is impossible to get 
estimates of the form (22) directly for stability of concrete difference prob¬ 
lems. Auxiliary mathematical tools and techniques such as the summation 
by parts formulae, the difference Green formulae and elementary analogs of 
embedding theorems are aimed at deriving various estimates for solutions of 
difference analogs of boundary-value problems associated with an ordinary 
second-order differential equation. In this particular case we will encounter 
typical situations related to stability, approximation and accuracy of dif¬ 
ference schemes. Later we will elaborate on this for rather complicated 
problems. At the same time, subsequent discussions of them will involve 
issues which are different from those occurred before. 



98 


Basic Concepts of the Theory of Difference Schemes 


2.4 MATHEMATICAL APPARATUS IN THE THEORY 
OF DIFFERENCE SCHEMES 


1. Some difference formulae. In the sequel, when dealing with various dif¬ 
ference expressions, we shall need the formulae for difference differentiating 
of a product, for summation by parts and difference Green’s formulae. In 
this section we derive these formulae within the framework similar to the 
appropriate apparatus of the differential calculus. Similar expressions were 
obtained in Section 2 of Chapter 1 in studying second-order difference op¬ 
erators, but there other notations have been used. It performs no difficulty 
to establish a relationship between formulae from Section 2 of Chapter 1 
and those of the present section. 

1) Formulae for difference differentiating of a product. As 
known from the differential calculus, the formula 


(uv)' = u‘ V + uv 


holds for differentiating the product of two functions u(x) and v(x). 

In Section 1 we have already introduced two types of difference deriva¬ 
tives for grid functions: the left and the right ones, which correspond to 
different formulae for difference differentiating of a product 


( 1 ) ( UV )x = U X v + v ‘ ( ' + l ' >v x = u x + u v x , 

(2) (uv) s =u s v + = u s v (_1) + uv s . 


Here we retain the notations 


/( ±1 ) = /(.T±h), /, = 


/ ( 


+ 1 ) 


/* = 


/ - ,f ( - 


In this context, we draw the reader’s attention to the fact that these for¬ 
mulae involve the index shift. Let us prove, for instance, the first equality. 
With this aim, we write it in the index form 


M i +1 u i +1 


U; V, 


-S + l u i +1 


u i+l 


C+l 


which assures us of the validity of the equality. 

2) The summation by parts form/ulae. We recall the integration 
by parts formula 

i i 


dx = 


dx . 


o 


o 
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As in the previous case similar formulae of two types 

(3) (u, v x ) = u N v N -u 0 v 1 - (tij , u] , 

(4) (u,v x ) = u N v N ^ 1 -u 0 v 0 ~[u x ,v) 

are valid for grid functions keeping the notations 

N -1 N N—l 

(5) (u,v)= E u i v i h > (u,v] = u i v i h < [«>^)= E u i v i h - 

2 = 1 2 = 1 2 = 0 

Let us prove, for instance, (3). First, applying formula (1) yields 


N—l N—l 

Y ( uv )x,> h ~Y w(+ 1 ) )i h 

2=1 2=1 

N 

(uv) N - (uv ) 1 ~Y^ v )i h 

2 = 2 
N 

(uv) N - Wj V t - Y U S,i V r h +(u s v) 1 h. 

1=1 

Second, it is obvious that h(u s v) 1 = u 1 v 1 — u 0 v } . Substitution of the 
preceding into (6) along with (5) yields (3). 

In what follows we will frequently employ a non-equidistant grid de¬ 
noting it by Q h in contrast to an equidistant introduced in Section 1. On 
any such grid the formulae of the inner product and the difference summa¬ 
tion by parts formulae are somewhat different: 


JV-l 


(6) Y ( uv xh h 


2 = 1 


iV-1 iV-1 

(«, u)* = y u i v i r h > k v ) = Y u i v > hi +i ’ 

2=1 2=1 

( 7 ) 

N 

(ll, u] = Y U i V i h i > ( u < V x)* ~ U N V N~ u 0 V 1 - ( v , %■] . 

2 = 1 

where = ^(h i + /i i+1 ). The notations for the difference derivative on a 
non-equidistant grid 
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and the inner product on a non-equidistant grid ( , )* allow a simpler writing 
of the ensuing formulae. 

To prove (7), a simple observation that 


v,~. = 


H+i 

h; 


v x , 


V,, 


i+1 


h i+ 1 


may be useful. Indeed, substituting this expression into the inner product 


n-l 

(u, v £ ) t = (u, v x ), where (u, w) = £ u t ^ h l+l , 

2 — 1 


and following the proof of identity (3), we arrive at (7) as desired. 
3) The first Green formula. The equality 



dx + kuv' 


is usually called the first Green formula. 

For grid functions an analog of the Green formula can be obtained by 
the summation by parts formulae. This can be done by substituting 


u= z, v = ay s 

into (3). The outcome of this is the first difference Green formula 

( 8 ) (g (« y s )x) = ~(ay s , z s ] + azy s \ N - y x . fi z 0 . 

If z 0 = z N = 0, the last two terms in (8) vanish and the first Green formula 
appears in simplified form: 

(8') (z, Ay) ~ ~(ay s , z s ], Ay ~ ( ay x ) x . 

In particular, for z = y the preceding becomes 

(8") (Ay, y) = — (a, (y x ) 2 }, y 0 = Vn = 0 . 

In the case of a non-equidistant grid we obtain a similar result: 


(g = -( a Vx . z x] + azij x \ N - a 1 y xfi z 0 

(z, (ay x ) x ) * = -(cty x , z x ] for z 0 = z N = 0 . 
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4) The second Green formula. In the integral calculus the fol¬ 
lowing formula 


i i 

J u ( kv 1 ) 1 dx — J v (ku')' dx — k (uv — W)|o 
o o 

is known as the second Green formula. Inserting u = y and v = az t in (3) 
yields 

(9) (y, (« 2 r) J = ~( al Js , y + ayz x .\ N - a L y 0 z xfi . 

Substracting (9) from (8) we derive the difference analog of the second 
Green formula 

(10) (z, (ay x ) x ) - (y, (az x ) x ) = a N ( zi Jx - z x y) N - a l (y x z - z x y) 0 . 

In just the same way as was done on a non-equidistant grid, we find that 

(11) (z, (ajAg)^ - (y, (az x ) £ ) t = a N (zy x . - z x y) N - a 1 (y x z - z x y) 0 . 

If y and z vanish at the points x = 0 and x — 1, the appropriate terms 
in the expressions being substituted into (3) are equal to zero, thereby 
reducing to 

(10') (Ay, z) = (y, Az), Ay = (ay £ ) v , 

(11') (Ay, z)* = (y, Az)*, Ay = (ay x ) i . 

These formulae confirm that the operator A is self-adjoint. 

5) The Cauchy-Bunyakovskii inequality and the e-inequality. 
In the sequel we shall need the well-known Cauchy-Bunyakovskii inequality 

I(«t)I < II«|| • || n ||, 

where (, ) is the inner product in a vector space and j|«|| = yqu, u) is 
the associated norm. To be more specific, (, ) designates one of the inner 
products we have introduced above. 

In what follows we will frequently employ the inequality 

III 2 

| ab | < e a —|— — , 
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where e > 0 is an arbitrary number, which is sometimes referred to as the 
e-inequality, permitting us to establish 


( 12 ) 


|(u,u)| < II U II ■ IMI < e|M| 2 + 


2. The search for eigenfunctions and eigenvalues in the example of the 
simplest difference problem. The method of separation of variables being 
involved in the apparatus of mathematical physics applies equelly well to 
difference problems. Employing this method enables one to split up an 
original problem with several independent variables into a series of more 
simpler problems with a smaller number of variables. As a rule, in this 
situation eigenvalue problems with respect to separate coordinates do arise. 
Difference problems can be solved in a quite similar manner. 

In this section we consider the problem of searching for eigenvalues of 
the simplest difference operator. 

Results we are going to obtain here will be needed in the sequel because 
applying the method of separation of variables leads to problems just of the 
same type. In the next chapters we give various examples of employing this 
method for the discovery of stability and convergence of concrete difference 
schemes. 

Before giving further motivations, we would like to recall the basic as¬ 
pects concerned with the elementary problem of determining eigenfunctions 
and eigenvalues for the differential equation 


(13) 


'(x) + A u(x) = 0, 0 < x < l, u( 0) = «(/) = 0 . 


The nontrivial solutions of this problem, that is, the eigenfunctions u k and 
the appropriate eigenvalues X k are expressed by 

1. 


kirx 


(x) = \l -j Sin — 


A, = 


Pit 2 


l 2 


-, At = 1,2,... 


2. The eigenfunctions u k constitute what is called an orthonormal 
system: 


I 1 l k( x ) u m( x ) dx = h-r. 


where S, m = 


0, k ^ m, 
1, k = m . 


3. If f(x ) is twice differentiable and satisfies the nonhomogeneous 
boundary conditions /(0) = /(/) = 0, it arranges itself into a uniformly 
convergent series 

OO 

f( x ) = E fk u k( x ) 

k=z 1 
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where f k = / f(x) u k (x)dx; in so doing 
o 

1 00 
Wf\\ 2 = I p(x) dx=Z ft- 
0 * = 1 

We put the difference problem 

y$x + X V = 0 X = ih, 0 < i < N, h = jr , 

(14) 

2 /( 0 ) = 2/(0 = 0 , y(x)£ 0 , 

of searching for nontrivial solutions being the eigenfunctions and eigenvalues 
of problem (14) in correspondence with the differential problem (13). For 
this, the index form of (14) is 

(15) y i+1 - 2(1 - \h 2 \) Vi + Vi _ x = 0, i = 1,2,... , N - 1 . 

We look for a solution of problem (14) in the form 

y{x) = sin ax 

with a to be determined. Along these lines, 

y i+1 + j/j_ j = sin a(x + h) + sin a(x — h) = 2 sin ax cos ah . 

Substituting the expression just established into (15) yields 

2 sin ax cos ah = 2 (1 — i h 2 A) sin ax . 

Since only nontrivial solutions are those to be found, that is, sin ax ^ 0, it 
follows from the foregoing that 

1 — | h 2 X = cos ah 

and 

X = J^( 1 ~ cos ah ) = ^2 sln Y ■ 

The value of the parameter a is chosen in such a way that the function 
y(x) — sin ax satisfies the boundary conditions of problem (14): 


2 /( 0 ) = 2 /(/) = 0 . 



104 


Basic Concepts of the Theory of Difference Schemes 


Observe, that the boundary condition at the point x — 0 is automatically 
fulfilled for any a. At the point x = l we have 

sin al = 0 , 


giving a = a k = kir/l, k = 1, 2, ... , N — 1. 

Thus, we have obtained the eigenfunctions and eigenvalues of problem 
(14). A brief survey of their properties is presented below. 

1 . 


(16) i/ k \x) = sin^, 





knh 

~2 T 


k = 1,2,... , N - 1 . 


2. The eigenvalues X k are enumerated in increasing order and for the 
whole collection {A^.} the estimates holds: 

.. 4 . 2 7 rh 4. 2 irh(N — 1) 

(17) 0 < A, = ^ sin 2 — < A 2 < • • • < A A r_ 1 = ^ sin 2 -- L 

4 2 7r ^ 1 4 

= h? cos 21" < F ' 

In particular, it follows from (17) that all the eigenvalues of problem (14) 
are positive. 

3. Eigenfunctions of problem (14) ]f k \ y^ m \ corresponding to distinct 
eigenvalues, are orthogonal in the sense of the inner product (5): 

(18) (j/*),y (m) ) = 0, k^m. 

To prove this fact, we make use of the second Green formula for the 
homogeneous boundary conditions (10'): 

0 = - {v {k \y £>) = (A m - K) (?/E y (m) ). 

In light of our supposition, and are eigenfunctions corresponding 
to distinct eigenvalues, that is, X k yf A m , the orthogonality of y^ and y 
follows from the preceding equality: 

(y {k \y {m] ) = o. 

4. The norm of an eigenfunction y( k \x) is || y^ || = y/lj 2. Recall 
that the norm is understood in the sense of the inner product (5): 

N — 1 

l|y|| 2 = (y,y) = E y\ h - 

i— 1 
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suits 

(19) 


We perform simple algebraic calculations and write only the final re- 
N— 1 


N-l 

y [ k) || 2 = ( y {k \ x s)Y h = E h sin5 

3=1 

2irkx, 


5 = 1 

N-l 

E 

S=1 


irkx s 

~7~ 


2 E cos / 


Using q k = exp {i } and taking into account that q s k = exp {i -f- x s } 
and qN = 1, we find that 
iv-i „ , N- 1 


y: h cos —ic s = Re /i = R eh — -P = Re /P 


9k ~ 1 


S =1 5 = 1 

Substitution of this value into (19) yields 

„ fU„2 h{N~\) t h hN l 

H' V 11 = -2-+ 2 = ^ = 2 

Thus, the set of grid functions 


9 k ~ 1 


-h. 


( 20 ) 


/J- k \x) = y( k \x), k — 1,2,. .. , N — 1 


constitutes an orthogonal and normed system in the sense of the inner 
product (AEA< (m) ) = 6 km . 

5. Let a function f(x) with the values f 0 = f N = 0 be given on a grid 
Lu h . Then, obviously, it can be represented as a sum of the eigenfunctions 
of problem (14): 


( 21 ) 


N — 1 

/(*) = E A PEE 

k— 1 


where the coefficients are defined by the relations f k — [f (x), ^ k \x)). 
What is more, in that case 


( 22 ) 

Indeed, 


N— 1 

/'II 2 = E fl 

k = 1 


IV-1 /N-l N-l \ 

ll/ll 2 = E hf 2 (x l ) = (f,i)= £ .4PEE a PE 

i— 1 \k = l k~ 1 / 

f N-l \ N-l N-l 

= E A/mPE (m) ,i = E aaPPPPE = E 

\k ,m= 1 / k } m= 1 

since {N\y- {m) ) = as established before. 


k—l 
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3. Eigenvalue problems with boundary conditions of the second and third 
kinds. We now turn to the second eigenvalue problem 

(23) u" + Xu = 0, 0 < x < l, u^O) = t< / (/) = 0, u(x) ^ 0 . 

With the relations u x 0 = u'( 0)+ | hu"(0) + O(h 2 ) = ~^hAu(0) + O(h 2 ) and 
u x o + ^hAu(O) = 0(/i 2 ) i n v i ew > we approximate the boundary conditions 
with accuracy 0{h 2 ), leading to the second boundary-value problem on 
eigenvalues: 


(24) 


Vsx + X v( x ) = 0 > x-ih, i - 1,2,... ,N - 1, h = ~ , 
Vxfi + 2 hXl Jo — o> ,N d - 2 ^ x vn = 0 ■ 


In such a setting it is required to find the values of the parameter A 
such that these homogeneous equations have nontrivial solutions y(x) ^ 0. 
In contrast to the first boundary-value problem, here the parameter A enters 
not only the governing equation, but also the boundary conditions. The 
introduction of new sensible notations 


(25) 


Av — 



■ v* 


for x = 0 , 

for x — ih, 

for x = /, 


0 < i < N , , 


is connected with setting problem (24) in the operator form 


(26) 


Ay = A y , 


where the operator A acts in the space H = 0 comprising all the functions 
y(x) defined on the grid tu h = {x i — ih, i — 0,1,, N}. 

We introduce in that space the inner product 


N—l 

[y, = E ih v i h + f (y 0 v o + vn v n) 

i — 1 

and show that the operator A is self-adjoint and nonnegative. By definition, 
this means that 


[Ay,v] = [y,Av ], 

[Ay, y] > 0 for any y G H 
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Indeed, 

[Ay, u] = (~y Sx , u) + - (-- v 0 y xfi + - v N y s>N } . 

Making use of the second Green formula (10), we get 
[Ay, u] = (y, ~v xx ) + (vy x - yv x ) 0 - (vy x - yv x ) N + ( -v 0 y x 0 + v N y s>N ) 
- (y, ~ v xx) + (~y 0 v x,o + vn v x,n ) = [y, M , 
that is, A = A*. The first Green formula (8) gives for z = y 

[Ay, y\ = (y, ~ysx) + ( s/o Vx,o + Vn Vx.n) 

— (vx> ~~Vx\ — (yyx)N + (yy x )o + ("% y x ,o + vn v x ,n) 

= (yx,yx] > o. 


Problem (26) can be solved by appeal to the general theory (see Sec¬ 
tion 1). Let us determine the eigenvalues X k and eigenfunctions y k (x) of 
problem (24) accepting a solution of problem (24) in the form 

y = y(x) = A cos ax , A yf 0 . 


Upon substituting y{x) into equation (24) we get 


A 



ah 

~2~ 


We now require the boundary conditions to be satisfied at the points 
x — 0 and x — l. The condition cos ah — 1 + L h 2 X = 0 is automatically 
fulfilled at the point x = 0. The case where x — l is not simple to follow 
and needs investigation: 

(l — A h 2 A) cos al — cos a(l — h) = 0 


or 


cos ah cos al — cos al cos ah + sin al sin ah — sin al sin ah = 0 , 

implying that al = irk, k = 0,1,2,... , N. Thus, we have determined the 
eigenvalues 


= 


4 

h 2 


sin 


7 rkh 

~2 T ’ 


(27) 


A 0 = 0, 


k - 1,2,. .. , TV , 
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and the orthonormal eigenfunctions {/j k (x)}, for which 

[kk ’ km\ ^ 


where 


( 28 ) 


J km 


1, k = m, 
0, k zfz m, 


ko 


1 

7 ’ 


kN 


1 ttN x 

i cos ~T~ 


kk 


1 nkx 

1 cos ~T~ 


1 , 2 , 


, TV — 1 


The normalizing multiplier Ak can be recovered from the condition 


\[kk \\ 2 = [Pk>kh\ = A l cos cos 


7 Tkx irkx] 

- rns - 


where the sum 


/ 7r kx irkx\ 2 7r kx 

j^cos ——, cos —— J = 2_^ “ cos —-— 

S=1 

is calculated by analogy with the preceding section. The orthonormality of 
the eigenfunctions {)JL k } follows from the general theory, since A — A* > 0 
and all the eigenvalues are simple. 

Any grid function f(x) defined on the grid c o h arranges itself into a 
series of {fi k (x)}: 

N 

f( x ) = E fkkk( x ), fk = [f,kk\, k = 0,l,...,N, 

1 = 0 

N 

under the inner product structure [/,/] = 7D /*• 

& = 0 

The statement of the third boundary-value problem on eigen¬ 
values is 


u" + A u(x) = 0 , 0 < x < /, 

17(0) = cr 1 u( 0), <Tj > 0 , 

— u'(l ) = a 2 u(l) , a 2 > 0 , u(x) ^ 0 


( 29 ) 
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As can readily be observed, the difference scheme of second-order approxi¬ 
mation acquires the form 

(30) y Sx + A y = 0 , x = ih, i = 1, 2,... , N — 1 , 

(Vx,o ~ a i Vo) + \ h\y 0 = 0, 

~(y s ,N + a 2 Vn) + \ hx VN = 0 , y(x)^ 0, 

yielding 

u x,o ~ a i u o + \ h\ u 0 = u' Q + | hit" + 0(h 2 ) - u 0 + ^ hX u 0 = 0(h 2 ) . 

It will be sensible to introduce the operator A with the values 

•j^ 

for * = 0 - 

(31) Ay = < —Vxx for x = ih , 0 < i < N , 

1 

„ q-^ (vx + a 2 y) fo1 ' * = /, 

by means of which problem (30) admits an alternative form of writing 

(32) Ay = A y . 

The domain of operator (31) coincides with the entire space H, the domain 
of operator (25), A + A* > 0 and, what is more, 

[Ay, y\ = ( y x , y s ] + <r 1 y 2 + a 2 y 2 N , 

it being understood that A > 0 if either at least one of the coefficients a 1 
and <j 2 becomes nonzero or a 1 + <7, > 0, but a 1 > 0 and a 2 > 0. In that 
case [Ay, y] = 0 only for y(x) = 0, 

Unlike the preceding two problems, we come to nothing in trying to 
derive the explicit formula for a. The parameter a should be recovered 
from the equation 

(33) (sin 2 ah — h 2 a 1 <r 2 ) tg al — h (cr 1 + <r 2 ) sin ah , 
but the eigenvalues are expressed, as usual, by the formulae 

(34) = sin2 ’ ^ = 0,1,2,... ,1V. 

The eigenfunctions are determined within a constant by 

(35) y k (x) = cos a k (/ - x) + sin a k (/ - x ). 
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4. Difference analogs of the embedding theorems. In the estimation of var¬ 
ious properties of difference schemes such as stability, convergence, etc. we 
shall need yet inequalities corresponding to the simplest Sobolev embed¬ 
ding theorems. In this respect the appropriate results have been obtained 
with the following lemmas. 

Lemma 1 For any grid function y(x) defined on the grid 
ui h — { x i = 0<i<N 1 x o = 0 1 x N = l} 
and vanishing at the points x = 0 and x — 1 the inequality holds: 

(36) \\y\\ c < i \\y s }\. 

where \\y\\ c = max^^ | y(x) \ and || y.]\ = (y s> y s } 1/2 . 

Proof The function y(x) given on the grid O h can be expressed in the form 
of the identity 

(37) y 2 (x) = (1 - x) y 2 (x) + xy 2 (x). 

With the assigned values j/(0) = y( 1) = 0, one can write down 

E y s { x ') h ') or v 2 ( x )=( E y s ( x> ) h 

x' = h J \x' = x-\-h 

Upon substituting these equalities into (37) we find that 

y 2 (x) = (1 - x) ^ j 

Let us estimate the sums on the right-hand side of the preceding relation 
with the aid of the Cauchy-Bunyakovskii inequality: 

XX 11 

y 2 ( x ) <(1-*) Y h J2 yl( x ') h + x h Yj y 2 A x ') h 

x' = h x' = h x'—X-\-h x' = x-\-h 

1 

= x(i-x) Y yl( x> ) h: = x ( 1 - x )\\y^}\ 2 , 

x'—h 

where y 2 = (y_) 2 . The maximum of the expression x{\ — x) on the segment 
[0, 1] is attained at the point x = | and equals Therefore, 

y 2 i x ) < q IkJI 2 


h V A 


= h 


E hvA x ') 

x' = x-\-h 




and, consequently, 
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Remark 1 Lemma 1 remains valid on an arbitrary non-equidistant grid 
“h- 


Remark 2 In the sequel we will also use an inequality of the type (36) for 
segments of arbitrary length l. Such an inequality can be derived from (36) 
by merely substituting x' = l x. Then x' varies on the interval (0, /) and 

V s > - y x ! I , b! - hi. 

By inserting y_ = y , l and h — h' j l in (24) we arrive at the chain of the 
relations 


N 


M ‘=EM 

*=i 


1 E (V S ‘)]W = l\\y s 

»=i 


Consequently, on any interval of length / 

(38) \y(x) | < || y || c < | Vl ||y-]| . 

Remark 3 Inequalities (36) and (38) are valid for all the functions vanish¬ 
ing at both ends of the interval in view. Being concerned with the function 
y{x) vanishing only on the boundary, one can derive another inequality 

(39) \\y\\ c < V7 111/_ ] |. 

Inequalities (36), (38) and (39) fail to be true, in general, for arbitrary 
functions. However, it is plain to show that in this case the inequalities of 
alternative forms occur: 


< 2 (' ll !<,]| 2 + !/ 0 2 ), 


y|g < 2 PI|y, 


Lemma 2 For any function y(x) defined on an arbitrary grid 


^h ^'0 9 , x N /} 


and vanishing at the points x = 0 and x — l the inequality holds: 

(40) II y\\ 2 < j II yjl 2 > yo = i/« = 0- 

Indeed, it is easy to check that || y || 2 < /||j/||^. Substituting this inequality 
into (36) yields (40). In the case of an equidistant grid estimate (40) can 
be improved and the reader is invited to do it on his/her own. 
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Lemma 3 Any function y(x) defined on the equidistant grid 

Co h — i x i = * = 0 , 1 , ..., N, x 0 = 0 , x N = /} 

and vanishing at the points x = 0 and x = / admits the estimates 

(41) ^l|yjl 2 <l|y|| 2 <^l|y,]| 2 . 

Proof We have occasion to use the expansion of y(x) with respect to the 
eigenfunctions of problem (14): 

A'-l „ N-l 

y( x )= E ga (<0 (E> c k = (2/0*0. z^OO) > II 2 / II = E c l- 

k— 1 k=l 

By the first Green formula (8) we thus have 

(42) (-Ay, y) = || y_]| 2 , 

where A y = y Sx , || y s ]| 2 = (1, (t/_) 2 ] . 

By definition, A = —X k p^ k ' ) and, therefore, 

N- 1 

-Ay = E c k x k ^ K x )- 

k— 1 

Let us substitute this expression into (42) and take into account that { } 

is an orthonormal system. As a final result we obtain 

\\y s ]\ 2 = -(Ay, y)= E h c l- 

k = l 

We deduce from here that Aj || y || 2 < || y_]| 2 < X N _ x || y || 2 , where 
A irh 4,7r/i 

A ' = 77 sm 17’ A «- = F cos ' 17 ■ 

The next goal of our studies is to construct a lower bound for Aj with 
respect to a = irh / (21)'. 

it 2 / sin a A 2 
1 = "P ) ' 

Since h < 0 . 5 /, the quantity a is varying on the half-interval ( 0 , it / 4], 
It is easy to check that the minimum of the function for a £ ( 0 , 7r / 4 ] is 
attained at the point a = tt /4, that is, Aj (h) attains its minimum in the 
case where h = 0 . 5 /. This serves to motivate that Aj > 8 / / 2 . Taking into 
account also that A Ar _ 1 < 4//i 2 , we come to (41) and finish the proof of 
the lemma. 
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5. The method of energy inequalities. One of the general and very effective 
ways of constructing a priori estimates is the method of energy inequalities. 
We bring several examples illustrating how to use this method in deriving 
a priori estimates in difference problems and find, for instance, the rate of 
convergence of a difference scheme on the basis of these estimates. 

In this section we consider the simplest model problem 

(43) u"(x) + f(x) = 0 , 0 < x < 1, u(0) = u(l) = 0 . 

Example 1 Assuming that an equidistant grid Co h is given on the segment 
[0, 1], we now consider the difference approximation of problem (43) 

(44) y S x + /(*) =0 ’ x £u h , y 0 = y N = 0. 

Multipling equation (44) by hy and summing up the resulting equality over 
the grid nodes of u> h , we eventually get 

N-l N —1 

(45) E (y s Ji.Vi h + E fiyi h = o. 

i — 1 2 — 1 

We now rewrite (45) in terms of inner products, whose use permits us to 
reduce it to the following one: 

(46) (y- x> y) + (/, y) = 0 . 

Via transform of the first summand in (46) by the Green difference formula 
(8") we find that 

(47) -(y.,y.] + (f,y) = 0 or \\y .]\ 2 = (/, y). 

The estimation of the inner product (/, y) can be done using the Cauchy- 
Bunyakowskii inequality (12): | (/, y) \ < || /1| ■ || y ||. By Lemma 3, 

llyli < l|y f ]|/v / 8. 

Putting these together with (47) we deduce in agreement with Lemma 1 
that 

lk,]|<ii/ll/E8. 

We finally get one possible a priori estimate for the solution of problem 
(44): 


( 48 ) 


II2/lie < 11/11/(4^2) 
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This inequality will be aimed at estimating the rate of convergence of 
scheme (44). We write beforehand the equation for the accuracy of scheme 
(44): z — y — u, where u is a solution of problem (43) and y is a solution 
of the difference problem (44). Upon substituting y = z + u into (44) it is 
plain to set up the problem for z: 

(49) z sx + ip(x) = 0, x G u h , z 0 = z N = 0 . 

Here ip{x) = u_ + f(x) is the approximation error of scheme (44). For all 
sufficiently smooth functions u(x) it is well-known that ip(x) is a quantity 
of order 0(/i 2 ), thus causing the same type of the problem for the function 
z(x) as occured for the function y(x). Because of this fact, estimate (48) is 
still valid for z(x): 

(50) ||z|| c <|M|/(4V2). 

However, ip = 0(h 2 ) and, consequently, || z \\ c = || y — u \\ c < M /i 2 , where 
M is a positive constant independent of step h. In agreement with the above 
definitions (see Section 1) estimate (50) provides the uniform convergence 
of a solution of the difference problem (44) to a solution of the differential 
problem (43) with the rate 0(h 2 ). 

So far we have established an estimate for the rate of convergence in 
a very simple problem. It is possible to obtain a similar result for this 
problem by means of several other methods that might be even much more 
simpler. However, the indisputable merit of the well-developed method 
of energy inequalities is its universal applicability: it can be translated 
without essential changes to the multidimensional case, the case of variable 
coefficients, difference schemes for parabolic and hyperbolic equations and 
other situations. 

Let us show, for example, that this method leads without any difficul¬ 
ties to the desired result for the case of a non-equidistant grid. 

Example 2 Let a non-equidistant grid c u h be given on the segment [0, 1], 
On this grid problem (43) can be approximated as follows: 

(51) y si + f{x) = 0, x<Eu> h , y 0 =y N z= 0, 

(for the notations see Section 1.3, Example 1). 

For problem (51) one can derive an a priori estimate of the same type 
as estimate (48) for problem (44). However, in this case such an estimate 
fails to provide with a quite reliable idea on the speed of convergence of 
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scheme (51). We have shown in Section 1.3 that the local approximation 
error ip = w _ + / of scheme (51) is a quantity of order 0(/q) and 

(52) \\iP\\ c <Mh max . 

Estimate (52) indicates an effective reduction of the speed of conver¬ 
gence of scheme (51) on the non-equidistant grid <2) h in comparison with 
scheme (44) on the equidistant grid. However, as we have stated above, if 
the error of approximation is evaluated not in the grid norm of the spaces 
C or L 2> but in a specially constructed negative norm || • then the er¬ 

ror of approximation on any non-equidistant grid will be of the same order 
0(h 2 ). Namely, the negative norm 


l(-i) - 


N-l 

E h t 

2 = 1 


N~ 1 


E h k^k 


k — i 


1 1/2 


o(h 2 ) 


is good enough for our purposes. What has been said above implies that in 
the further derivation of a priori estimates for problem (51) the right-hand 
side should be evaluated in the negative norm || • ||(_jp 

Let us obtain this a priori estimate by multiplying equation (51) by 
y i h i and summing over all grid nodes of ui h . In terms of the inner products 
the resulting expression can be written as 


(53) (!/**,!/),+(/,!/),= 0. 

Via transform of the first summand in (53) by the Green difference formula 
(8) it is not difficult to establish the relation 


(54) (?4> V s ] = (/,?/)* • 

As we will see later, it will be sensible to deal with the function r/(x) specified 
by the relations 


(55) i) f]j = fi , * — 1,2,... ,7V — 1, y N = 0. 

While solving problem (55) it reduces to — ry(xj-) = J2k=i fk^-k' 

The inner product on the right-hand side of (54) is modified by the 
summation by parts formula (7) into 


(/, y)* = (’ 4 , y)* = -(»?, y s \ 
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On account of the Cauchy-Bunyakovskii inequality, 

I (/» y)* I = \ (v, y s ) I < Ihll • Ili/Jh 

Substituting this estimate into (54) and eliminating ||y ]| from both sides 
of the resulting inequality, we arrive at the relations 

' tV — 1 / N~l \ 2 I l/ 2 

lls/JI < IMI = =ll/ll ( _i)- 

By Lemma 1, 

II y lie < llyjl / 2 

and, consequently, we derive the relation 

(56) IIyHe < I ll/ll(_i). 

thereby justifying the desired estimate. Further development is connected 
with the accurate account of the error z = y — u, where y is a solution of 
problem (51) and u is a solution of the original differential problem (43). 
Upon substituting y = z + u into (51) the problem arises for the error z: 

(57) z s .+ip = 0 , * e ui h , z 0 = z N = 0 . 

Applying estimate (56) to problem (57) yields 

II z lie — 2 II ^ H(-l) ' 

However, we have stated in Section 1.3 that || ip l^-r) — Af/i 2 , where h = 
maxi<i<Ar/ij. Therefore, scheme (51) on an arbitrary non-equidistant grid 
Co h converges in the space C with the rate 0(h 2 ). 

2.5 DIFFERENCE SCHEMES AS OPERATOR EQUATIONS. 
GENERAL FORMULATIONS 

Difference schemes for the simplest differential equations have been con¬ 
sidered in preceding sections, the basic topics in the theory of difference 

schemes have been introduced for them as well as all the tricks and turns 

available for investigating stability and convergence of such schemes have 
been demonstrated with a great success. 

In this section a unified interpretation of difference equations as op¬ 
erator equations in an abstract space is carried out and, after this, the 
corresponding definitions of approximation, stability and convergence are 
presented. This approach is quite applicable in mathematical physics for 
stationary problems. 
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1, Difference schemes as operator equations. After replacing differential 
equations by difference equations on a certain grid ui h we obtain a system of 
linear algebraic equations that can be written in matrix form. The outcome 
of this is 

(1) UY = $, 

where 11 is a square N X TV-matrix, Y = (y 1 , y 2 , • • •, y N ) is the vector of 
unknowns and $ = (ip j, <p 2 , . . ., <p N ) is a known right-hand side including 
the right-hand sides of boundary conditions. With every matrix if one 
can associate a linear operator A acting from R N into R N . With this 
correspondence in view, equation (1) takes the form 

(2) Ay = <p, 

where the unknown vector y is sought, while the right-hand side <p £ R N is 
a given vector. The operator A maps onto itself the space of grid functions 
defined on ui h and satisfying the homogeneous boundary conditions. Several 
examples can add interest and aid in understanding. 

Example 1. The first boundary-value problem. Given on the segment 
[0, 1 ] an equidistant grid ui h = { x i — i h , i = 0, 1, . . ., N , h = 1 / N } , 
let us look for a solution of the first boundary-value problem 

(3) A y= y gx = -f(x) , 0 < x = i h < 1 , y 0 = iq , y N = u 2 , 

or 

1 

~f2 (Ui-l ^ Vi A Vi- (-i) fi> ^ 1,2,..., A" 1, 

y 0 = u i, Vn = u 2 

As the first step towards the solution of this problem, we form the vector 
Y = (f/j, y 2 , . . ., y N _ 1 ), making it possible to rewrite equation (3) in the 
form (1) with the (At — 1) x (At — l)-matrix 

/ 2 -1 0 0 ... 0 0 

-1 2 -1 0 ... 0 0 

0-12 -1 ... 0 0 

\ 0 0 0 0 ... -1 2 
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The right-hand side vector $ = (ip x , ip 2 , ... , <P N _ 1 ) includes the right-hand 
sides of the boundary conditions (3) 

U 'll 

Pi ~ fi > i — 2, . • ., N — 2 , ip x — /i + ^ > Pn —\ = /jv-i + Jp> > 

so that ipi may differ from /,• only at the grid nodes adjacent to the boundary 
points, that is, for i = 1 and i = N — 1. 

The matrix it specifies an operator A = —A, carrying a grid function 
y(x i ), that is, a vector of the (N — l)-dimensional space into a vector of 
the same space (into the grid function (—Ay),). The operator A coincides 
with the operator A on all grid functions vanishing at the boundary nodes 
(for i = 0 and i— N), so that (A y) i = (A y), for i = 2, 3, ..., N — 2 and 


(4) 


( A v)i = 


-2 y x + y 2 

h 2 


( A 2/L_i = 


y N — 2 1 

h 2 


Let be the set of grid functions defined at the inner nodes of the 
grid Lo h . The set so constructed is certainly linear. Once equipped with the 
inner product (y, v) = Vi v i ^ an< 4 associated norm || y\\ = y/(y, y), 

the space Q h becomes a normed vector space. The above operator A is 
linear and maps into itself, meaning that the domain and range of the 

operator A coincide with the entire space Q h . 

0 

Let Q h be the space of all grid functions defined for all nodes of the 

grid Co h and vanishing at the boundary nodes, that is, for x G Jk- Then 

0 

the operator A may be treated as an operator from 0 into Q h . Obviously, 
A — A h , y — y h and ip = ip h depend solely on the grid step h. Just for 
this reason the subject of subsequent discussions is a family of equations 
depending on the parameter h rather than the single equation (2). A family 
of such equations constitutes what is called an operator-difference scheme 
(see Section 1.2). 

While solving the operator equations (2) we establish the basic prop¬ 
erties of the operator A such as self-adjointness, positive definiteness, the 
lower bound of the operator and its norm and more. The operator A con¬ 
structed in Example 1 will be frequently encountered in the sequel. Before 
stating the main results, will be sensible to list its basic properties. 

The operator A is self-adjoint, that is, (Ay, v) = (y, Av) for any 
y, v G Q ;i . As a matter of fact, (Ay, v) — (—Ay, v). Making use of the 
second Green formula (Section 3) and taking into account that A coincides 
with A on the set of grid functions vanishing at the boundary nodes, we 
establish the relation (Ay, v) = (y, Av), implying that A = A*. 
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The operator A is positive definite, that is, (Ay, y) > 8|| y || 2 . This is 
a consequence of Lemma 3 in Section 3.4. 

The norm of the operator A is equal to 


(5) 


^11 = 


4 

h 2 


, it h 
cos — 
2 


< 


4 

h 2 ' 


Indeed, the norm of a self-adjoint positive operator in a finite-dimensional 
space Q/j is equal to its greatest eigenvalue: || A || = case > i n 

complete agreement with the results of Section 4.2, we might have 


A 


N-l 


_ 4 _ 

h- 


9 7T H 

COS - 

2 


and, therefore, formula (5) holds true. In addition, 


(Ay, y) < mil • || y || 2 ■ 


The next quantity we will introduce is an operator with the values 


(6) Ay = —( ayA) x + dy , 0 < c 1 < a < c 2 , 0 < d < c 3 . 

Due to the second Green formula it is self-adjoint. In turn, the first Green 
formula assures us of the validity of the relation 

(7) (Ay, y) = (a, y 2 \ + (dy, y), 
where y 2 — (j/_) 2 . This implies that 

(8) (Ay, y) > c., (1, y 2 } = cjl y_]| 2 > 8c 1 1| j/1| 2 , 

meaning that A is positive definite. It seems clear from formulae (7) and 
(8) that its norm satisfies the estimate || A || < 4 c 2 /h 2 + c 3 . 


Remark Here the operator A — A h depends only on the grid step h playing 
for the moment the role of parameter. When ui h = { x i G [0, 1], i = 
0, 1, .. ., N, x 0 = 0, x N = 1 } is a non-equidistant grid, its step h i = 
x i — x i _ 1 itself becomes a grid function or an TV-dimensional vector h = 
(h 1 , h 2 , . .., h N ). The operator A admits the form A = —A, where 


A Vi = 


1 

h i 


Vi+i - Vi _ Vi - Vi-i \ _ t 

h i+i h z ) ~ 




1 

2 


(hi + h i+1 ) . 
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In this case we write, as before, A = A h with further reference that h is a 
vector of the dimension TV, that is, an element of the space consisting 
of all functions defined on the grid 

= { x i ^ (0, 1], * = 1,2, ... , TV, x N = 1 } . 

Example 2. The third boundary-value problem. Given the same 
grid Q h as in Example 1, we now consider the difference boundary-value 
problem of the third kind 


Ay = y sx = -/(*), 

(9) 

Vx, o = a i Vo - hi . 


0 < x = i h < 1, 

-y s ,N - a 2 y N - ih ■ 


Let Cl h be a set of all functions defined on the grid ui h = { x { = ih , i = 
0, 1, ..., N }. We begin by specifying the operator A by the relations 


(Ay)i = 


(y x ,0 - a i Vo) = A y, 

A y = V s r > 

1 

“q 5 /j (yx,N “I" = A+ y , 


i = 0, 

i = 1,2,... ,N - 1, 
i- N . 


By merely setting A = —A problem (9) is recast as 


( 10 ) 


Ay = f , 


where 


<Pi = 


1 

Ch5h ’ 

/<> 

1 

EE) ^ 


i = 0, 

i = 1,2,... ,7V - 1, 
i = N. 


The linear operator A maps Cl h onto Cl h . To make our exposition more 
transparent, it will be convenient to introduce the inner product 


iV-l 

[y, v }= E yi v i h +\ h (y 0 v 0 + y N v N ) 

i -1 


and the associated norm | [y\ | = \J[y, y\. The operator A is self-adjoint, 
that is, [y, Av] = [u, Ay], where 

[y, Av\ = -(y, A v) - ^ h ( y 0 A“ v + y N A+ v ) 
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and (y, e = eZi 1 Hi uq h. Making use of the Green formula from Section 
3 and substituting the relevant expressions for A - v and A + v, we find that 


-(y> Av ) = (“A y, v) - (y x>0 v o - y sN v N ) + (i Jo v xQ - y N v gN ), 

-0-5 h(y 0 A~ v + y N A + v) = —y 0 ( v x>0 - cr, v 0 ) + y N (m ^ + a 2 v N ) . 

Since y x0 = cr 1 y 0 + 0.5 h A~ y and y_ N = —<r 2 y N — 0.5/iA + y, we arrive 
at the chain of the relations 

[y, Av] = -(Ay, v) - 0.5 h(v 0 A~ y + v N A + y) = [Ay, v] 
as required. 

We are going to show that if cr 1 > c 1 > 0 and c 2 > cq > 0, then the 
operator A is positive definite: 

(11) [Ay,y] > ^ | [y] p. 

1 + Cj 

With this aim, we follow the same procedures as we did in the proof of 
Lemma 1 in Section 3. Namely, those ideas are connected with attempting 
the function y 2 (x) in the form 


y 2 ( x ) = (y 0 + E y s i x ') h ] =Vo+ 2 yo E y s ( x ') h +( E y s ( x ') h 

\ x' — h J x'~h \x'~h 

and applying then the e-inequality. The outcome of this is 

y 2 ( x ) < (i + £ )i / o + ( 1 + ( E ft ys( x ') h ^j ■ 

By the Cauchy-Bunyakovskii inequality, 

( E y s { x ') h ] < x ( E y 2 ( x ')h] < x(i, y 2 ], 

\ x' — h J \x' —h J 


2 


implying that 


y 2 ( x ) < (i + e)y 0 2 + (1 + x ( l , y 2 }- 
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Likewise, one can prove another inequality 

y 2 (x) < (1 +e)y 2 N + (\ + ^ (1 - x)(l, y 2 } . 

By the same token, 

y 2 ( x i) < \ (i + £ ) (?/o + y 2 N ) + i ^ i ~ ^ v\ \ , 

I [y] I 2 < I(i + e) (y 0 2 + + 2 (i + ^ ) (i> ^] • 

Putting e = Cj and using the identity 

( 12 ) U y, y] = (i, y\ ] + oq y 0 2 + <r 2 yj; , 

we establish relation ( 11 ). 

It is plain to deduce for the norm of the operator A the estimate 

4 

(13) 11 j4 11 < j ~2 (l + ^ c 2 h.), where c 2 = max ( 04 , <t 2 ) . 
Indeed, 

2 

( y x,i y - ^ + y i-1 ) 

and 

(mlJ £ ^ 1MI 2 . 

where | [y\ | 2 = vf h + ^ h (y 2 + y 2 N ). By virtue of the relations 

[Ay, y] < |M|| • | [y] | 2 , 

y 2 + y 2 N = \ (\ h *1 y 2 0 + \ h «2y 2 N ) IM I 2 

we get from (12) the desired estimate (13), 
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Example 3. Non-self-adjoint operators. Let Co h = { x t = i h , i = 
0,1,..., TV, /i=l/7V}bea, grid on the segment 0 < x < 1 and let the 
difference operators 

(14) A ~ y = y_, A + y= -y -, 

0 

mapping the set Q h of grid functions defined on ui h and vanishing for i = 0 
and i = N into Q h , be such that 


(A y)i 


Vi/h, i - 1 , 

(Vi ~ Vi-i )/ h > i = 2 - 3, . . ., N - 1 , 


(A+y) 


y N -i / h , i=N-l. 


These formulae show that the operators A and A + can be treated under 
such an approach as operators from Q h into Q h . 

Let (y, v) = i = / Vi v i ^ l” 3 H 113 i nner product in and Q, h . It seems 
clear that the operators A - and A + are mutually adjoint: 


(15) (A y, v ) = (y, A + v ) for any y,v£0, h . 


Indeed, by the summation by parts formula we have —(y, v x ) = (t/_, v) if 
y = v = 0 for i = 0 and i = N. This just implies the fact that A - and A + 
are operators adjoint to each other. We note in passing that 


A + A+ = -(y x . - y.) = -hAy, 

where Ay = y Sx , that is, A - + A + = —h A. Therefore, the operators A 
and A + are positive definite: 

(A“ y, y) = (A+ y, y) = ~ (-Ay, y) = ~ \\y x ]\ 2 > 4/r|| y\\ 2 . 

The last inequality holds true on account of Lemma 3 in Section 3.4. 

Later we will deal with operators from £l h into Q h of the structure 


R ' v = h y 


R 2 V = ( “I/® ) : 


R , 


A" 




A+. 


( 16 ) 
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They are mutually adjoint, that is, (R 3 y, v) = (y, R 2 v) and 

{Riih y) = (R 2 y, y) = \ llz/JI 2 > 4 l|y|| 2 - 

The useful relation 


N ~ l 

\\Riy \\ 2 = h ~ 2 Y y 2 s h < Ah ~ A IMI 2 

i = l 

provides the validity of the following estimates: 


(17) 

Since R 1 = R*, 


R I 


2 


- h 2 ' 


{ r i r 2 y> y) = \\ R 2y\ 


1 N -1 

P £ 


N 




,l h 2 


yielding 


(18) \\ R 2 y\\ 2 < ^ (Ry,y), R = R 1 + R 2 . 

0 

The difference operator R 3 y = p j/o = | ( R x — R 2 ) y, y £ Q h , is obvi¬ 
ously skew-symmetric due to the relationships 

^3 = 5 (RI-K)=U R 2- R i )=- R 3 

and, consequently, (R 3 y, y) = 0. Its norm satisfies the estimate 


^3 II < 2 ( II 721 II + II R 2 


2 

- E' 


It is not difficult to refine the estimate for II R , II with the aid of relations 


l N -1 

IT? 


1 JV-1 


juI 2 = 7t? E (%+i -%-i ? h < yh E (y 2 +1 + y 2 _J^< y 

* = 1 z n i =1 


h 2 


giving || R 3 \\ < 1 /h 2 . 

Non-self-adjoint difference operators appear, for example, in the ap¬ 
proximation of second-order elliptic operators with the first derivatives. 
The operator Lu = u"(x) + bii'(x) , x G [0, 1] , b — const, is approximated 
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by the difference operators Aj y = y gx + b y x for b > 0 or A 2 y = t/_ + b y x 
for b < 0 with y £ . 

~ 0 

Let A y be an operator from into coinciding with A y for y £ Q h . 

The operators A 1 = —A 1 and A 2 = — A 2 , acting from Q h into Q h , are 
positive definite for any h. Indeed, 

(A y,y) = (-y El .> y)- & y) = (i + 5 II]| 2 , 

(19) 

(Ay. y) = C 1 - \ hb ) Wv s ]\ 2 = C 1 + k h l 6 l) lly s ]l 2 - 

We conclude from here that 

(Ay. y) > 8(1 + |/i | 6 |)IIyII 2 


for a — 1, 2. 

Be re-ordering A t — A + b A + and A 2 = A + | b \ A~ , where A = —A, 
Ay -y Sx and || A ± || < 2 / h, || A || < 4 / h 2 , we are led due to the triangle 
inequality for the norms to 


IIA 

II < IIA 

I + &IIA+II 

< ^( 1+ k hb )> 

b > 0 , 

HA 

II < IIA 

l + A||A- II 

< J^( l + k h l 6 l). 

b < 0 . 


We note in passing that if we approximate the operator L u~ u" + ba' by 
the expression Ay = y Xx + b y x for b > 0, then the member 1 — | h b arises 
in place of 1 + ^ h b m (19) and thereby the operator —A will be positive 
definite only for h < 2 / b. 

If «'(x ) is approximated by the central difference derivative « x for 
any sign b, we have the operator A 3 y = ~A 3 y, where A 3 y = y Xx + b y 
This operator A 3 y = —y- — h b R 3 y is of second-approximation order and 
satisfies the relations 

(A y, y) - ( -y $x . y) - h b ( R 3 y, y) = 11 y x ] | 2 

and 

II A II < IIAI + Zi I & l II All < ~^2 A h | 6 |). 

Although the complete theory could be recast in the general case, we 
confine ourselves to simplest examples. In subsequent chapters the differ¬ 
ence operators approximating elliptic operators (in particular, the Laplace 



126 


Basic Concepts of the Theory of Difference Schemes 


operator) in rectangular domains will be studied by means of similar meth¬ 
ods. If the initial differential operator is self-adjoint and positive definite, 
one should construct the difference operator also to possess these proper¬ 
ties in the grid space. This can be achieved, for example, by employing the 
balance method (the integro-interpolation method from Chapter 3) or the 
variational method in designing difference schemes. 

We learn from the examples under consideration that the difference 
equations can be treated as operator equations with operators in a finite- 
dimensional normed vector space. A feature of such operators is that they 
map the entire space into itself as further developments occur. 

We proceed to the description of the theory of difference schemes 
treated as operator equations, the meaning of which we have discussed 
above. 

2. Stability of a difference scheme. Let two normed vector spaces B^ and 
be given with parameter h being a vector of some normed space with 
the norm | h | > 0. In dealing with a linear operator A h with the domain 
V(A h ) = B^ and range 7 Z(A h ) C B^ we consider the equation 

(21) A h y h = n , VneB^, 

where is a given vector. Varying the parameter h, we obtain the set 
of solutions { y h } to equation (21). We call the operator equation (21) 
depending on the parameter h a difference scheme. 

Let || • 11^^ and || • ||^ 2 ^ be the norms on the spaces B^ and B^\ 
respectively. Scheme (21) is said to be correct or problem (21) is said to be 
well-posed if for all sufficiently small | h \ < h 0 

(1) a solution y h of (21) exists and is unique for all <p h £ B^ (scheme 
(21) is uniquely solvable), 

(2) this solution continuously depends on ip h and this dependence is 
uniform in h (scheme (21) is stable). In other words, there exists a 

positive constant M independent of h and <p h such that a solution 

C21 

to equation (21) admits for any ip h £ B^ J the estimate 

(22) ||yJ (u) <M|| n || (2;i) . 

The meaning of the solvability of scheme (21) is that there exists an inverse 
operator A J) 1 such that 


( 23 ) 


Vh = A 1 fh- 
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Stability of the scheme is to be understood as the property that the inverse 
A^ l acting from B^ into B^ is uniformly bounded in h: 

(24) || A^ 1 || < M where M > 0 does not depend on h . 

Combination of (23) and (24) gives estimate (22): 

N/J(U)<IK 1 H ' II Ah 11(2.) < M H n. 11(2*)' 

That is to say, the meaning of stability of scheme (21) is that a solution (21) 
depends continuously on the right-hand side and this dependence is uniform 
in the parameter h. This implies that a small change of the right-hand side 
results in a small change of the solution. If the scheme is solvable and 
stable, it is correct. Note that the uniqueness of the scheme (21) solution 
is a consequence of its solvability and stability and, hence, we might get 
rid of the uniqueness requirement in condition (1). Indeed, assume to the 
contrary that there were two solutions to equation (21), say y h and y h yl y h . 
By the linearity property of the operator A h , their difference z h = y h — y h 
should satisfy the homogeneous equation 

A h z h = A h ( Vh - y h ) = A hVh ^ A h y h = Ah - Ah = 0 ■ 

Because scheme (21) is stable, inequality (22) holds true and, therefore, 

II z h ll( U) = II Vh ~ Vh ll(u) - M II 0 ll( 2)l ) = 0 > 

implying that y h = y h . 

To prove the stability of (21), we need an a priori estimate of the form 
(22). A derivation of some a priori estimates for the operator equation (21) 
will be carried out in Section 4. A difference scheme A h y h = is said 
to be ill-posed if at least one of the conditions (l)-(2) we have imposed 
above is violated. 

Suppose that a solution y h of problem (21) exists for any ip h £ B^ , so 
that y^ 1 = A;") 1 <p^. Since B^ and B^ are finite-dimensional spaces, the 
inverse operator A^ 1 from B]' A into B^ A is bounded and its norm equals 
|| A^ 1 || = M ft , where M h is a positive constant depending on the parameter 
h. If the scheme is stable, there exists a constant M > 0 independent of h 
such that M h < M for all \ h\ < h 0 . The meaning of instability of scheme 
(21) and, hence, of its ill-posedness is that M h —»• oo as | /i | —>- 0, it being 
understood that the above constant M does not exist. For an ill-posed 
problem only an estimate of the form 



128 


Basic Concepts of the Theory of Difference Schemes 


may be true. 

Here the meaning of weak stability is that condition (25) should be 
valid. In other words, this asserts that there exists a domain for \h\, for 
example, 0 < /i* < \h \ < h 0 , where (22) is satisfied with constant M, 
depending on /i*. 

The definition of well-posedness and ill-posedness of a scheme is closely 
connected with the selection rules for norms || • and || • ||( 2)i p If ma y 

happen that for some choices of'these norms estimate (25) is fulfilled, while 

for the others estimate (22) is true. It is worth noting here that for the 

0 

scheme Ay = —y. = ip for y G Al h , as stated in Section 3, estimate (22) is 
still valid in the norms 


11% 11(1,0 = 11% ll c 


max 


Vh( x i) I > 


M = 1, 


II^IW) = 


rtv-i 


E h 


N-l 


E 


h< Pk 


2 1 1/2 


3. Convergence and approximation. Let BA) and BA) be liormed vector 
spaces with norms || • ||^ and || • ||^, respectively. One assumes, in 
addition, that 

(1) there exist linear operators from BA) into Bp and v\P from BA) 
into BP known as projectors such that 


V ( Pu = u h G B' 


(i) 


if tiGfif 1 ) and V[ 2) f = f h £ B ( h 2) 


if fe bA) 


(2) the conditions of concordance of norms are satisfied: 
(26) 


lim 
OH o 


I 'pA ) 11 

Ah u N(U) 


'( 1 ) 


lim II V? ] f 
| h HO h 


1(20 


= 11/1 


( 2 ) • 


Given a vector y h of the space B^\ we study the convergence of { y h } 
as | h | —>• 0 to a fixed element u from BA). 

1) A sequence { y h }, where y h G B^\ is said to be convergent to an element 
u G B A) if 

(27) ! l.m o l| Sl -H«ll (1 „, = 0. 

2) A sequence { y h } is said to be convergent to u h G BA) with the rate 
0( | h | n ), n > 0, or { y h } approximates u with accuracy 0( | h \ n ) if for 
all sufficiently small \ h\<h 0 the estimate is valid: 

(28) ll%-«JI (u) < M \h\ n , H=n (1) % 

where M > 0 is a constant independent of h. 
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Remark 1 Convergence conditions (27) imply that 

(29) = ||«|| (1) . 


Indeed, with the aid of the triangle inequality and the relation u h — V^u 
one can write down 

II Vh ll(l t ) — II ( Vh ~ u h ) + u h ll(i fc ) 

- II lJ h ~ U h ll( U ) + II u h ll (U ) 

< II % - Uh ll(l fc ) + II 'Ph'* U ll(l fc ) • 

Passing to the limit as | h | —»• 0 and taking into account (27) and (26), we 
obtain 

li^oll^ H (1 o - II U H (1) - 

A similar reasoning yields 


l u ll ( i) < 


lim I 

1 h 1—>-0 


Vh 


'(U) 


giving (29). 

Remark 2 The sequence { y h } can converge only to a single element 
u £ B^\ On the contrary, let there exist two limit elements w, u £ B^\ 
u yf u ({ Uh } converges to each of them), that is, 

,lim o H % -h ; J (u) = i lim o || Vh - Uh ll (ljl) = 0 • 

We are going to show that u yf u by considering the difference 

u h = (u h -y h ) + (yh - u h) 

and appealing to the triangle inequality 

II u h - u h || (1;0 <|| y h - u h || (u) + || y h - || (u) . 

Passing to the limit as | h | —»• 0 and taking into account the convergence of 
y h to both u and u and the norm concordance condition (26), we deduce 
that || it — u = 0, implying that u = u. 
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Let y h be a solution of problem (21). We say that 

1) scheme (21) converges if there exists an element u £ such that the 
limit relation (27) occurs; 

2) the scheme is of accuracy 0( | h | 2 ) if there exists an element u £ B^ A 
such that for | h \ < h 0 relation (28) occurs. 

Let us define the notion of the approximation error on an element 
u £ B A ), To this end, we must write down the equation for the difference 
z h ~ Vh — u h - Substitution of y h = z h + u h into (21) gives 

(30) A h z h = i> h , tp h = ip h - A h u h , i) h £B^\ 

In this context, we call the right-hand side ip h = ip h (u) depending on the 
choice of an element it from B i 1 ) the error of approximation on the element 
u £ B t 1 ) for scheme (21). Obviously, il^ h (u ) is the residual emerging as a 
result of replacing y h by the element u h £ V^u in (21). 

We say that 

1) scheme (21) generates an approximation on an element u £ B 1 - 1 ) if 

(3 1 ) II A ( u ) ll(2 t) = j II Vh ~ A h u h ll ( 2„) = 0 1 

2) scheme (21) is of the ?rth approximation order on an element u £ B A ) if 
for sufficiently small | h \ < h 0 

(32) ||^(«)|| (2k) <M|/ l |" or \\M u )\\ {2h) = 0( |h| n ), 

where M is a positive constant independent of h, h > 0. 

Our next goal is to establish direct links between stability, approxi¬ 
mation on an element u £ B^ A and convergence to u for scheme (21). If' 
scheme (21) is correct, then problem (30) for z h is well-posed. Because of 
this fact, its solution obeys the estimate 

(33) ' HoJ (ll0 <MU h \\ [2h) . 

In this respect, we obtain the profound result with the following the¬ 
orem. 

Theorem 1 If scheme (21) is correct and generates an approximation on 
an element u £ BA), then it converges. More precisely, a solution y h 
of problem (21) converges to this element u £ B^ as | h \ —»• 0 and, in 
addition, the order of accuracy of scheme (21) coincides with the order 
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of approximation, that is, approximation ancl correctness (stability) of a 
scheme imply its convergence. 

Until now we spoke about convergence of a scheme and approximation 
on a fixed element u of the space BA). However, if u belongs to the domain 
of a linear operator A from B ^ into B^ 2 ), then Au = /, f £ BA). Hence, 
u can be adopted as a solution to the equation 

(34) Au = f, /e6< 2 ), 

and, therefore, one can speak about the approximation of this equation by 
a difference scheme. The only reason we did not introduce equation (34) for 
it is that no restriction on the operator A was imposed in the definitions. 
Everywhere we have dealt only with an element u £ BA). 

However, if u is a solution to some equation like (34), then one can 
speak, as usual, about the approximation of equation (34) by scheme (21) on 
a solution of equation (34), about the convergence to a solution of equation 

(34) , etc. 

Once started with the notion of approximation to an element / from 
BA) by a set { ip h } from { B ^ }, we can speak about the approximation of 
/ by the elements ip h as well as about the approximation of an operator A 
by A h : 

1) i p h approximates / with order h if 

(35) ll^“'^ 2) /ll (2t) = 0( 1*1"); 

2) an operator A h approximates an operator A with order n if for any 
u £ BA) 

(36) iM ftUft -^f ) (yi U )ii (2ft) = iMan (1) «)-n (2) (^«)ii (2t) 

= 0 ( |*|”). 

Obviously, if conditions (35) and (36) are satisfied, then scheme (21) 
is of the ?rth order of approximation on the solution u to equation (34), 
With the relation f — Au) = 0 in view, 

■>Ph(u) = ‘Ph - A h u h 

= {Vk~'Pl 2) f)~{A h (T { h l) u)~TP(Au)), 

II M «) ll (2 „) < II <Ph - n (2) /IU) + \\A h ( V^u) - Vl 2 \ -4«)|| (2j0 

<M\h | n , 



132 


Basic Concepts of the Theory of Difference Schemes 


provided conditions (35)—(36) hold. From such reasoning it seems clear that 
the converse assertion, in general, fails to be true, that is, relations (32) do 
not imply conditions (35) and (36). 

Let us stress once again that in order to estimate the order of accuracy 
of a scheme, it is necessary to estimate its order of accuracy only on a 
solution of the original problem. 

So far we have always preassumed that the operator A h is linear 
(scheme (21) is linear). If A h is nonlinear (scheme (21) is nonlinear), the 
preceding arguments need minor changes only in the concept of stability. 
Ill dealing with a nonlinear scheme 

(21*) A h y h = p h< ^e4 2) ; 

where y h is a solution and y h is a solution with the right-hand side (p h G 
B^\ scheme (21*) is said to be stable if there are positive constants h 0 > 0 
and M > 0 independent of the parameter h and disregarding to the choice 
of (fi h and (p h such that for | h | < h 0 the inequality 

( 22 *) II Vh - Vh ll (U) < M ll Ph - Ph ll^) 

is satisfied for any <p h , <p h G B ( h . We note in passing that for a linear 
scheme with ip h = 0 and y h — 0 this implies (22). All of the above defi¬ 
nitions of approximation and convergence remain valid. Theorem 1 is also 
true. However, its proof follows another reasoning: instead of (30) it is 
more cinvenient to write down 

A h u h = Ph> Ph^Ph-i’h* ^h = Ph- A h u h> 

where is the approximation error (residual) on the element u G B A \ 
Denote by y h a solution of equation (21*), y h = u h and make use of the 
stability condition (22*). We obtain in this direction estimate (33) 

II « 11(H) = II Vh~ u h 11(H) ^ M II Vh, 11(2,0 = M II Ph~ A h u h 11(2,0 > 

thereby completing the proof of Theorem 1 for a nonlinear scheme as well. 

4. Some a priori estimates. We now consider several simplest a priori 
estimates for a solution to equation (21), the form of which depends on the 
subsidiary information on the operator of a scheme. These estimates are 
typical for difference elliptic problems. 

For simplicity of writing we will omit the subscript h if this does not 
cause an ambiguity. The equation we must solve is of the form 

(37) Ay = p , 
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where A is a linear bounded operator defined in a real Hilbert space H, p> 
is given and y is sought in the space H. 

We will assume that problem (37) is solvable for any right-hand sides 
p> £ H: there exists an operator A -1 with the domain V( A -1 ) = H. All 
the constants below are supposed to be independent of h. In what follows 
the space H is equipped with an inner product ( , ) and associated norm 
|| x || = \J(x, x ). The writing A = A* > 0 means that A is a self-adjoint 
positive operator. Set 

HHL-i = \/(^ _ V <p), IML = V(Ay,y), a-a*>o. 

An a priori estimate depends on the nature of the subsidiary information 
on the operator A. 

Let H be a finite-dimensional space. 

1) Consider first the simplest case when A is a non-self-adjoint positive 
definite operator: 

(38) A > 6 E , 8 > 0 or ( A y, y ) > 6 j| y || 2 for any y £ H , 

where E is the identity operator. Then the inverse A -1 is bounded in norm 
by the constant 1 / 6: 

(39) 

Indeed, 

0 < (Ay, y)-6\\y || 2 = (A~ l x, x) - 5 || A _1 x || 2 

< || A~ l x || ■ || x || — 6 || A~ l x || 2 

= 6 II A_1 x || f ^ || £ || — || A~ l x || \ , x = Ay , 


implying that 11 A 1 x \ \ < 6 1 11 x \ \ or 11 A 1 11 < 6 1 . Since y = A 1 <p and 
|| y || < || A -1 || • || p> ||, the solution to equation (37) admits the estimate 

(40) IMI<^IMI for A> 6 E , 6> 0. 

2) The precise estimate appears to be useful: 

IMLHML- 


for A = A* > 0 . 
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To make sure of it, we take the inner product of (37) and y = A 1 p: 
(Ay, y) = (p, y) = (p, A~ l p) 


°r||j/||* 

3) If A > 0, then 

(41) llylL 0 <IMI V , A 0 = i(A + A*). 

Furthermore, taking the inner product of (37) and y we obtain 

(42) (Ay, y) = (p, y), A = A 0 + A 1 , 

where A 0 = | ( A + A* ) is the symmetric part and A 0 = 4 ( A — A* ) is 
the skew-symmetric part of the operator A. This provides the sufficient 
background for the relation (Ay, y) = (A 0 y,y) due to the fact that 
(A 1 y, y) = 0. As far as A 0 > 0, the inverse operator A~ l exists, be¬ 
cause the space H is finite-dimensional*! and, therefore, by the generalized 
Cauchy-Bunyakovskii inequality one can write down 

(p, y) =■ (A~ l p, A 0 y) < IML-' ' IML 0 • 

Substitution of this inequality into (42) leads to the relations 

(A 0 y, y) = \\y\\ 2 Ao < \\y\\ Ao ■ , 

from which the desired estimate (41) immediately follows. 

4) If A > 6 E with 6 > 0, then 

(43) \\y\\ Ao < 

To prove this fact, we make use of estimate (41) and the inequality 

IMh-i < |5_1/2 II^II. 


which is a consequence of 

A 0 >6E and \\pW\_, = (A~ l p, p) <\\ A~ l \\ ■ \\pf < \\pf. 


*)lf H is an infinite-dimensional space, one should require instead of A > 0 that 
A > S' E with 6 > 0. 
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5) Assuming A to be a non-self-adjoint operator subject to the inequality 
0 0 0 

A > 7 A with 7 > 0 and A* = A > 0, we derive for a solution to equation 
(37) the estimate 

(«) II # 11 ; < (iMIj-.- 

The identity (Ay,y) = (<p,y) yields the chain of the relations 


l(Ay,y)<(Ay,y) = (<p,y)<\\<p\\o • ||r/||= , 

A A 

thereby providing the validity of (44). 

6 ) For a solution to equation (37) we thus have 

(45) \\°Ay\\ < i |H| 

7 

under the following conditions: 

A* = A>yA, A = A* > 0, A A = A A , j > 0 


0 


It suffices to show that ||Aj/|| > 7 || A ?/1| and to involve in further reasoning 

0 0 

equation (37), giving ||At/|| = ||y||. The conditions A > 7 A and A A = 
0 

A A together imply the chain of the relations 


\Ay\\ 2 = (Ay,Ay) = ( A( A 1/2 y), ( A 1/2 y )) 

> 7 ('A(A 1/2 y), ( A 1/2 y )) =7 (AAy,y) 

= 7 (A(A 1 / 2 j/),(A 1 / 2 j/)) > 7 2 ( A( A l/2 y), ( A 1/2 y )) 

= 7 2 \\°Ay\\ 2 , 


0 

meaning || Ay\\ > 7 11 A j/11. Here we exploit the fact that the operators A 

° ° 

and A 1 / 2 as well as the operators A and A 1 ' 2 commute with each other. 
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5. Negative norms. In a priori estimates (41) and (42) we were dealing with 
the negative norm || ip ||^_i. Just for this reason the question of computing 
negative norms for the simplest operators will be of great importance. First 
of all we quote a result of simple observations: 

(46) IMU-i < ^ IMI°_! if A >1 a, 

0 0 

where A = A* > 0 and A = A* >0. This follows from the equivalence of 
the operator inequalities 

(47) A > j A and A* 1 >7 A -1 . 

Our first goal is to prove the equivalence between the inequalities Q > 0 
and L*Q L > 0, where Q, L: H 1 —► H and L ” 1 exists. Indeed, 

( L*Q Ly, y) = (Q Ly, Ly) = ( Qv , 1 ;), 

0 0 

where v = Ly and y = L~ l v. Accepting A>jA or Q = A — y A > 0 and 

0 

setting L = L* = A -1 ' 2 , we obtain C — 7 E > 0, where 

c= °a- 1/2 aa- 1/2 = C* > 0. 

Since the operator C -1 / 2 = (C~ 1 ^ 2 )* > 0 does exist, the inequality C — 
7 E > 0 is equivalent to 

C~ 1/2 (C-jE)C~ 1/2 = E-yC- 1 = E-' i A l l 2 A- i A 112 >0. 

0 0 

By merely setting L = L* = A~ 1 ! 2 we get A -1 — 7 A -1 > 0, what means 
that inequalities (47) are equivalent as required. 

Example 4 Consider the first boundary-value problem 

A y = (ay ) 3 . = -<p(x i ), x { = ih, i = 1, 2, . .., N - 1 , 

(48) 

h N = 1 , y 0 = y N = 0 , a i > c i > 0 , 1 = 1, 2, ..., N, 

on the uniform grid ui h = { — i h , i = 0, 1, 2, . . ., N , h = 1 / N }. One 

0 

assumes, as usual, that H h = Q h is the space of all grid functions defined 
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on w h and vanishing for i = 0 and i = N under the inner product structure 

(V, v ) = EilT 1 Vi v i h in H - 

As a first step towards the solution of this problem, the operator A is 
defined by the relation Ay = —Ay, where Ay = Ay for y £ Q, so that 

(49) ( Ay)i = -(ay- ) xi , i = 1,2,.. . , N - 1 , ( A y ) 0 = ( A y ) N = 0 

and the vector p is taken to be p = (0, p ly p 2 , p N _ lt 0). The next 
step is to recast the problem in view as an operator equation 

Ay - p. 

It is easy to see from Green’s formulae 

(y, (ay s )x) = -(a. (it) 2 ] 


and 

( v >( a y s )x) = (y>( av s )x)> 

0 

where y , v £ Q, that the operator A is self-adjoint and positive definite, 
that is, A > 6 E, 6 = 8 c l . Recall that we have established in Section 3 
from Chapter 2 that 

(Ay,y) = (a, [y s f] > G (1, (y £ ) 2 } > 8 eq j|y|| 2 . 

This implies that the inverse A -1 exists and (A -1 )* = A -1 > 0. More 
exactly, 

~ E < A " 1 < - E. 

A|| - 6 

Let us show that the negative norm ||y||^_i of operator (49) is repre¬ 
sentable by 


(51) 

IMIL, = £ £ S? - 


> , N u \ - 1 

£7 ■ 


2 = 1 1 

S‘ = 1 1 ' 

^ i=l ' 


2—1 



(52) 

= 

i = 2, 3, 

11 

0 


k~ 1 
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All this enables us to derive for this norm the estimate 


(53) 



i-l 

E 


h< fk 


For its proof the right-hand side of equation (48) is expressed in the 
form — S x j, i = 1,2, . . . , N — 1, where 5) is specified by conditions (52). 
The equation ( a y ) x + if — ( a y s + S ).,. =0 implies that { + 5) = c = 
const for all * = 1,2,... , N. Whence y i — y i _ l = h (c — 5) ) / a i . Summing 
up over i = 1,2, . . . , N and taking into account that y 0 = y N , we deduce 
that 



On the other hand, 

II9? || l-i = <p) = (y, <p) = (y, S x ) = ~(S, y.] 

= “E LhV'jS,. 

Substituting y g . = ( c — ,5) ) / cq yields 


IM 


2 






-1 


as required. Estimate (53) is simple to follow; 


N , , N 


i 

c i 


TV- 1 


E '■■4+,= 


1 


Y 

k~ 1 


Example 5 Consider now the third boundary-value problem (9). As in 
Example 2 of Section 1 it will be convenient to introduce the space H h = Cl h 
of the dimension A r +1 consisting of all grid functions defined on the uniform 
grid ui h = { aq = i h, i = 0, 1,2, . .. , N, h = 1/N } under the inner product 
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structure [y, v] = Y!i=\ l yi v i h + k h ( y o v o + Vn v n )■ Then problem (9) 
reduces to an operator equation of the form 

A V = 

where y and ip are the vectors of the dimension N + 1: 


y = { y 0 , 2 / 1 . • • •» y N -i> 


1 , , 1 

0.5 h ^ Jn - 1 ' 0.5 h ^ 


and the operator A acts in accordance with the rule 


“oT/i (yVx ' a * = °> 

(54) (Ay) i= < ~y SXii , l<i<N-l, 

^-^Jh^ y s,N- a 2 y N ), i = N. 

The negative norm of operator (54) is expressed by the collection of formu¬ 
lae 

(55) IMIq-! = f] 

= lT s - 3 + ^ s h.-(| l '*s« + ^s«.) /(> + ^ + ^). 


( 56 ) S 1 = \h<p 0 , Si = \ hip 0 + ^ h( Pk > * = 2 , 3 , ..., N , 

k — 1 

AT-1 

5' n+1 = | h ( ^ h( Pk 

k — 1 

and admits the estimate 

(57) IMIq-i < || x h fo + zT ^ifc] | 4- 

71 2 fc = i cr 2 

In establishing these relations the grid should be enlarged by recording 
two “artifical” points x.j = —h and x N+1 = 1 + h and assigning the values 
y{ x.j ) = 2 /_j =0 and y{ x N+1 ) = y N+1 = 0. All this enables us to impose 
the boundary condition in (9) for i = 0 as follows: 
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In just the same way as before, we write down the boundary condition in 
(9) for i = N: 

a N +1 ( Vn+1 Vn ) ( yN Vn-1 ) - 

h? “ ’ 

1 - 1 
a N+i = h a 2 , ip N = -ip N . 

In such a setting problem (9) turns out to be equivalent to the first boun¬ 
dary-value problem 

(58) -(ay s ) xi = (fii , i = 0, 1, . . ., N , 2 /_j = y N+1 = 0 , 

where & = ip it i = 1,2,. . . , N - 1, <p 0 = \<p 0) fp N = a { = 1, 

i = 1,2,... , N and a 0 = ha l , a N+1 = ha 2 . If jy is a solution of problem 
(9), then 

TV —1 

[A~ V, <p\ = [y, <p] = \h{y Q (p Q + y N cp N ) + £ y { h 

1=1 

N -1 N 

= E Vi Vi h + h ( y 0 fp Q + V N ) = E Vi 9i h 

i= 1 2—0 

= E ( A ~ 1 ( p)i i p l h - 

i = 0 

By applying successively formulae (51)—(52) to problem (58) and estimate 
(53) we arrive at (55) and (57). 

Corollary If u 7 > c 1 > 0, then operator (54) admits the estimate 

i -1 l 1 2 1 

(59) IMI 2 4 -i < Y) hi Pk + ^ hi Po + — 

k = 1 ^ J C 1 

6 . Operator equations of divergent type. We now deal with operators of 
the special structure known as divergent or conservative operators: 

(60) A = T*ST, 

where T, S and T* are linear bounded operators. Operators of this type 
are frequently encountered in this book in the approximation of differential 
operators having the form Lu = div(fcgradu). Let H be a vector space 
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with the inner product (y,v) and associated norm ||j/|| = \/(y, li) and let 
H j be a vector space with the inner product (y, v] and associated norm 
|| y\\ = \f{y, y\- Let, in addition, T be an operator from H into H 1 , S be 
an operator from H 1 into H 1 and T* be an operator from H 1 into H. Then 
the operator A really acts from H into H: A: H i—► H. The operators T 
and T* are mutually adjoint in the following sense: 

( T y, v ] = ( y, T*v ) for all y £ H , v £ H 1 . 

Before going further, we give below several examples illustrating how 
to construct factorized operators (60) for the simplest difference schemes. 

Example 6 Of our initial concern is the first boundary-value problem 


(61) (ay.) x = -(p, 0<x = ih<l, 

a > Cj > 0 , y 0 = 0 , y N = 0 . 

In this case H £ Q h is the space of all grid functions defined at the inner 
nodes of the uniform grid u> h = { x ( = i h , i = 0,1,2,... , N , h N = 1}, 
that is, for 0 < i < N and H 1 = is the space of all grid functions defined 
at the nodes of the uniform grid wjj’ = {x i = ih,i=l,2,...,N,hN — 
1 }. The operator A: H H equals Ay = —Ay, where Ay takes the form 

(Aj/)i = ( a y s )c,i , i = 2, 3, . .., N - 2 , 


( A y )i = 


( V2 - Vi ) - «1 Vi 

h 2 


( A y) N -i = 


Vn- 1 ^N- 1 (Vn-1 Vn~ 2 ) 


The inner products in the spaces H and H 1 are defined by 


N-l 


(y,v)= E Vi v i h fol ' Vi 


i= 1 
N 


(y, v] = E Vi v i h for Vi> v i e h, . 

i~ 1 

Under these structures, we specify the operators Ty, T*v and Sv by the 
relations 


(Ty), = 


Vi - %-1 


h > i ’ 


i = 2, 3, .... TV - 1 


( T »),= 


(Ty), 


Vn-i 

h ’ 
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so that v = T y E H 1 if y E H; 

(T*v) i = - Vl+l ~ Vi - , { = 1,2,... ,N - 1, 

so that T*v E H if v E H 1 . Finally, (S v ) i = for i = 1,2,... , N, 
that is, S v E H 1 if v E H 1 and (S v, v ] > c 1 1| v || 2 . From such reasoning it 
seems clear that 

(STy)i = a { y Sti , i = 2, 3, . . ., N — 1 , ( S Ty) 1 = a 1 y 1 / h , 

( ST y) N ~ a N Vn-i / h , 

{T*STy) i =~{ay.).. ) i = 1,2,... , N , for y 0 = y N = 0 , 

which serve to motivate that the operator of problem (61) can be factorized 
in the form (60) so as to have instead of (37) 

(62) T*STy = ip. 

The fact that the operators T and T* are mutually adjoint is a corollary to 
the summation by parts formula: ( y, v x ) = — ( v, y ], so that 

(y, T*v) - -{v, Ty\ . 

Example 7 The third boundary-value problem comes next: 

(63) (ay s ) x = -ip, 0<x = ih<l, a>c x > 0, 

«i y s> i = o-i % - » ~ a N y StN = <t2 2/ J v - ^ 2 . 

(Tj > Cj > 0 , <J 2 > Cj > 0 . 

In this case the operator A is of the form (see Example 2 in Section 1): 

- o]bi (ai!/j b i-(7i!/o) ’ f = 0 ’ 

(64) (Ay)i = < — ( a y s )x > 

. ^J] l ( a N y s ,N +> i = N. 

The operator (64) can be made of the same type as the preceding operator 
(60) if we impose another grid 

Sh = { x 0’ X l/21 •••) x i-l/2! ■■■ I x N-1/2’ > x i- 1/2 — (* — 2 ) ^ ’ 
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and work in the space H 1 of all grid functions defined on the grid ui l h under 
the inner product structure (y,v] = Eili hy i ~ 1/2 v i _ 1/2 + y N v N + y 0 v 0 and 
the norm || y] \ = y/(y, y]- As before, H is the space of all grid functions 
defined on the uniform grid ui h = {x i = i h , i = 0, 1, . . ., N , h = 1 / N } 
with the inner product (y, v ) = Ei = i v { h+ | h ( y 0 v 0 + y N v N ) and the 
associated norm ||j/|| = \/(y, y)- We specify the operators T: H H 1 
and T*: H as follows: 


(Ty ) 0 = y 0 , (Ty)i_ i / 2 = Vl Z 8 " 1 , * = 1,2,... , N , (Ty) N =~y h 


(T*y) o = 


J l/2 U 0 

0.5 h 


C T*v) f 


0.5 h 


(T*v) z 


k + l/2 v i- 1/2 


, i= 1,2,... ,N-1, yeH, ve H,. 


This provides support for the view that A = T*ST , where the operator 
S: H j H j is defined by the relations 


(Sy) 0 = <T 1 y 0 , (S y)i_ 1/2 = a l y i _ 1/2 , 1 < * < N , 

(Sy) N = a 2 y N . 

Obviously, S is a self-adjoint operator in H 1 and (Sy, y] > c a 11 y ] | 2 with 
constant c 1 = min (a i , u 1 , tr 2 ) . Let us show that the operators T and T* 
are mutually adjoint in the following sense: ( T* v, y) = (v, T y] for y £ H , 
v £ H 1 . Indeed, 


7V-1 

(T*v,y) = - E ( v i+i/2 - v i-i/2)Vi - y 0 ( v U2 - v o) 
i— 1 

_ Vn ( V N ~ V N- 1/2 ) 

N 

= E v i- 1/2 (Vi - Vi-i ) + y 0 v o~-y N v N 

i — 1 

= (v, Ty] . 

We are now in a position to derive some a priory estimates for the equation 
Ay = T*STy = <p. Under the natural premise S > c 1 E , c l > 0, we obtain 
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( A y, y) = (T*STy, y) = (STy, T y] > c^T y]\ 2 , 

meaning A > 7 A 0) where A 0 = T*T and 7 = c 1 . The operator A 0 is 
self-adjoint: 

(A 0 y, z) = (T*Ty, z) = (y, T*Tz) = (y, A 0 z). 

Therefore, estimate (44) holds true and takes the form 

(65) \\Ty}\ < ~ ||(T*)-V-]| • 

C 1 

It is worth bearing in mind here that the inverses T~ l and do exist. 

Indeed, 


\\y\\ 2 Ao = ( A oy,y) = \\ T v}\ 2 , 

\\<p\\ 2 a -i = (T~ 1 (T*y 1 ip,ip) = ||(t*)-V]| 2 - 

Estimate (65) can be simplified in the case when the right-hand side ip of 
equation (37) is of the special form tp = T*r/ and A = T*ST. The inner 
product of (37) and y discovers the relationships 

(T*STy,y) = (T* V ,y) = (Ty, 77]. 

Putting these together with the inequalities 

(T*STy,y)>c 1 \\Ty]\ 2 , ( T y, r,] < \ \ T y] \ ■ || ?? ]|, 

we derive the estimate 11 T y ] | < c 1 ~ 1 11 rj ] \. 

We have restricted ourselves to the simplest examples demonstrating 
how the a priori estimates that can be obtained through such an analysis 
for the operator equation Ay = p apply equally well to important problems 
arising in theory and practice. 
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This chapter presents the theory of homogeneous difference schemes for the 
solution of equations with variable coefficients 

Lu + f{x) = 0 , L u — —— f k(x) —— ] — g{x) u . 

LLtb y LLtiL/ J 


A special attention is being paid to various forms of homogeneous differ¬ 
ence schemes and their approximation and convergence for discontinuous 
coefficients k, q and / as well as for non-equidistant grids. Not much is 
known in such cases. Later in this chapter we will survey some devices that 
can be used to obtain simpler forms and higher orders. 


3.1 HOMOGENEOUS SCHEMES FOR SECOND-ORDER EQUATIONS 
WITH VARIABLE COEFFICIENTS 

1. Introduction. Modern computers permit implementation of highly accu¬ 
rate difference schemes. Just for this reason, it is unreasonable to develop 
difference methods and create high quality software for solving particular 
problems. An actual problem consists of constructing difference schemes ca¬ 
pable of describing classes of problems that are determined by a given type 
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of the governing differential equation, a class of boundary and initial con¬ 
ditions as well as of forming a functional space comprising the coefficients 
of the differential equation. Naturally, such universal difference schemes 
should possess the convergence and stability properties on any sequence of 
grids and for any original problem from the given class. The requirement 
of universality of computational algorithms for solving a class of problems 
necessitates imposing the notion of homogeneous difference scheme. By a 
homogeneous difference scheme we mean one whose form is indepen¬ 
dent of a concrete problem from this class and the choice of a grid. At 
all grid nodes the difference equations take the same form for any problem 
from this class. The coefficients of a homogeneous difference scheme are 
treated as functionals of the coefficients of the differential equation. 

For instance, of great interest are “through” or “continuous” execu¬ 
tion schemes available for solving the diffusion equation with discontinuous 
diffusion coefficients by means of the same formulae (software). No se¬ 
lection of points or lines of discontinuities of the coefficients applies here. 
This means that the scheme remains unchanged in a neighborhood of dis¬ 
continuities and the computations at all grid nodes can be carried out by 
the same formulae without concern of discontinuity or continuity of the 
diffusion coefficient. 

Homogeneous “through” execution schemes are quite applicable in the 
cases where the diffusion coefficient is found as an approximate solution 
of other equations. For instance, such schemes are aimed at solving the 
equations of gas dynamics in a heat conducting gas when the diffusion 
coefficient depends on the density and has discontinuities on the shock 
waves. 

In the theory of difference schemes with a primary family of schemes 
the coefficients of a homogeneous difference scheme are expressed through 
the coefficients of the initial differential equation by means of the so-called 
pattern functionals; the arbitrariness in the choice of these functionals 
is limited by the requirements of approximation, solvability, etc. There 
are various ways of taking care of these restrictions. The availability of a 
primary family of homogeneous difference schemes is ensured by a family 
of admissible pattern functionals known in advance. 

Let us clarify the subject of investigation in a more simpler situation 
through the use of difference operators acting on functions of only one 
variable aq = i h, i = 0, ±1, .... One way of proceeding is connected with 
the following' two steps. A difference operator is defined beforehand on 
an integral pattern, that is, on a set of the type 9Jt 0 = {—m L , —m l + 
1, . . ., —1, 0, 1, ... , m,}, where m l , m 2 are positive integers. The next 
step is the transition to the real grid ui h = {aq = ih, i = 0, ±1, . . .} 
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with step h. Let k(s) be a vector function defined for —m 1 < s < m 2 and 
called the coefficient pattern. In the sequel we are dealing with pattern 
functionals 

Al j[k(s)}, -urq < j < m 2 , B h [k(s)}, 

which usually depend on the parameter h and are defined for the vector 
functions k(s), s £ [— m lt m 2 ]. By a linear with respect to a grid function 
y h homogeneous difference scheme is meant y h ) { — 0, where 

m 2 

( L i k) y h )i = X A tl k ( x i + sh)} y h (xi + mh) + B h [k{x i + s h)\ . 

m = — m± 

Omitting the subscript i one can rewrite the preceding as 

m 2 

L h^y h = X/ A^n[k( x + s h)} y h ( x + mh) + B h [k(x + s h)} . 

The principal question in the theory of homogeneous difference sche¬ 
mes is connected with further design of admissible schemes within a primary 
family for solving a class of typical problems as wide as possible and choos¬ 
ing the most efficient ones (in accuracy, volume of computations, etc.). 


3.2 CONSERVATIVE SCHEMES 


1. An example of the scheme which is divergent in the case of discontinuous 
coefficients. We now consider problem (1) of Section 2.1 with q = 0 and 
/ = 0 incorporated: 


(1) (ku 1 )'= 0, 0 < x < 1 , «(0) = 1 , u(l) = 0 


As one might expect, the derivative ( ku should be replaced by ku" + k'u 1 . 
As a first step towards the construction of a second-order approximation, 
it will be sensible to carry out the forthcoming substitutions 


k' 


k ; 


i +1 


2 h 


■ l i +1 


2 h 


Within these notations, a reasonable form of the difference scheme is 


( 2 ) 


y i+l -2 y { + yi _, k i+1 - k { _, y i+1 - 


h 2 


2 h 


2 h 


0 < i < N, 


y 0 = i> 


Vn = °- 
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Reducing scheme (2) to the form (4) from Section 2.1 we find that 


(3) 


k i +1 


bi — fcj + 


i +1 


k t 


d- 


Vi 


whence it follows that scheme (2) belongs to family (4) from the preceding 
section. 

Conditions (5) and ( 6 ) from Section 2.1 hold true, since on segments, 
where the function k(x) is smooth enough, the relations occur: 


a i = ki - | h k' { + 0(h 2 ) , = k { -j- | h k\ + 0(h 2 ), 

H a i + b i ) = k i - b i - a i = H k i +1 ~ ^-i) = h K + °( h3 ) , 

so that a ; > 0 and b i > 0 for sufficiently small h. 

We are going to show that scheme ( 2 ) is divergent even in the class of 
step coefficients 


(4) 


f k l , 0 < x < £ , 

l k 2 , £ < x < 1 , 


with £ being an irrational number such that £ = ai n + Oh , x n = nh, 0 < 
0 < 1 . 

The exact solution of problem (1), (4) subject to the continuity con¬ 
ditions is of the form 

(l-a 0 x, 0 < x < £, a 0 = (x+( 1-x)^)" 1 , 

l/ ? o( 1 ” x ). £ < x < 1 , /? 0 = xa o. x-kjk 2 . 

We proceed to solve the difference problem (2), (4) in the usual way. Since 
a { = b i = k 1 for 0 < i < n and a i = b i = A : 2 for n + 1 < i < N, equation ( 2 ) 
reduces to y i _ 1 —2 y i + y i+1 = 0 for i yf n and i yf n + 1. Whence it follows 
that 


( 6 ) 


% = 2/(z») = 


1 — a x i , 0 < x < x n , 

/?(1 - - c ) . s n + l < » < 1 • 


The coefficients a and /? can be most readily recovered from the appropriate 
equations with i = n and i = n + 1 incorporated: 


b„ [/?(1 - £„+i) - (1 -«»„)] + a n ah = 0 , 
b n+1 Ph + a n+l [/?(1 - x n+1 ) - (1 -ax n )} = 0 . 


( 7 ) 
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From (3) and (4) we find that a n = | (5£q — k 2 ), a n+1 = | (k l + 3 k 2 ), 
h n = i (3£q+ £: 2 ) and 6 n+1 = jj(5fc 2 —fcj). Solving equations (7) with respect 
to a and /? and recalling the expressions x n = £ — 9h and x n+1 = £ + (l — 6)h, 
we determine the values ascribed to the parameters 


/? = n a , a = 


( 8 ) 


fi + (1 - fi) £ + h (A — 6 - (1 — 9) fi) 


3 + x 5x — 1 

n — - A , A = - 

5 — x 3x + 1 

The passage to the limit as h —► 0 yields 
lim a — d n , 


h^O 


lim /? = /?„, 

n.—► 0 


where 

( 9 ) 


a o = <T + (1 ~^K) \ /?o = A* a o- 


Via the linear interpolation we extend the functions (6) on the whole seg¬ 
ment 0 < x < 1. Under such an approach we have at our disposal a new 
function y(x, h), x £ [0, 1], which coincides with y { at the grid nodes x { = ih 
and possesses the limiting function as h —► 0: 


( 10 ) 


u{x) = lim y(x, h) = 


1 — a 0 x, 0 < £ < £ , 

A, (1 - x), £, < x < 1 . 


Comparison of u(x) with the exact solution u{x) specified by (5), where the 
coefficients d 0 , /?„ are determined by formula (9), shows that u(x) = u(x) 
for a 0 = a 0 and /?„ = /?„. But it is possible only if x = 1 or k 1 = k 2 . 
This provides support for the view that, as h —>■ 0, solution (6) of the 
difference problem'(2), (5) approaches the function u(x) other than the 
exact solution u(x) of problem (1) in the case k 1 yf k 2 . Due to this fact 
scheme (2) is divergent. 

Before stating the main results, it will be sensible to clarify a phys¬ 
ical sense of the function u(x), which solves problem (1) subject to the 
conditions [u] = 0 and [k u'] = — a 0 (q, — x) k 2 = q at the point x = £. 
Here q stands for the capacity of a point heat source (sink) at the point 
x = £. Being dependent on x, the quantity q varies very widely. Specifi¬ 
cally, q —► Too as x —*■ 5 ± 0. Thus, the physical reason for the convergence 
of scheme (2) is that the heat balance (the conservation law of heat) is 
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violated, thus causing the appearance of the extra heat source (for q < 0) 
or sink (for q > 0) at the point x = £. 

We call various schemes, in which conservation laws fail to be true, 
nonconservative or disbalanced. 

The above example shows that in designing difference schemes it is 
very desirable to reproduce the appropriate conservative law on a grid. 
The schemes with this property are said to be conservative. In subsequent 
sections the general method for constructing conservative schemes, which 
are convergent in the class of discontinuity coefficients, will be appreciated. 
Before we undertake the complete description of this method, it is worth 
noting two things. 

Quite often, in practical implementations without concern of theo¬ 
retical estimations of the desired quality of a scheme, the convergence of 
the scheme is verified by experiments in which the grids are successively 
refined. Sometimes this approach may cause erroneous conclusions on con¬ 
vergence of the scheme on account of some nearness between a solution of 
the difference problem and some limiting function u(x) during the course 
of successive grid refinement. In the above example the function u(x) may 
deviate, generally speaking, from the solution u(x) of the original problem 
as large as we like. That is why the method of successive grid refinement is 
employed with caution. Anyhow it cannot exclude theoretical investigations 
at least in model problems. 

The method of test functions is quite applicable in verifying conver¬ 
gence and determining the order of accuracy and is stipulated by a proper 
choice of the function U(x). Such a function is free to be chosen in any 
convenient way so as to provide the validity of the continuity conditions 
at every discontinuity point of coefficients. By inserting it in equation (1) 
of Section 1 we are led to the right-hand side / = ( kU')' — qU and the 
boundary values fi 1 = U( 0) and fi 2 = U( 1). The solution of such a problem 
relies on scheme (4) of Section 1 and then the difference solution will be 
compared with a known function U(x) on various grids. 

One more thing is worth noting here. It would be erroneous to think 
that every scheme, which is convergent in the case of smooth coefficients, 
is obliged to converge in the case of discontinuity coefficients. Further 
explorations are connected with a family of schemes converging in the class 
of discontinuity coefficients, thus expanding possibilities. Let us stress that 
in the sequel we will deal with such schemes only. 

2. The integro-interpolational method for constructing homogeneous dif¬ 
ference schemes. Various physical processes (heat conduction or diffusion, 
vibrations, gas dynamics, etc.) are well-characterized by some integral 
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conservation laws (of heat, mass, momentum, energy, etc.). Usually the 
derivation of a differential equation of mathematical physics is on an in¬ 
tegral relation (a balance equation) which expresses such a conservation 
law for a small volume. Letting the volume to zero and assuming that the 
derivatives involved in the balance equation are continuous, one can write 
down the appropriate differential equation. 

From a physical point of view, the finite difference method is mostly 
based based on the further replacement of a continuous medium by its 
discrete model. Adopting those ideas, it is natural to require that the 
principal characteristics of a physical process should be in full force. Such 
characteristics are certainly conservation laws. Difference schemes, which 
express various conservation laws on grids, are said to be conservative or 
divergent. For conservative schemes the relevant conservative laws in the 
entire grid domain (integral conservative laws) do follow as an algebraic 
corollary to difference equations. 

In this view, it seems reasonable to construct conservative difference 
schemes with the aid of balance equations for an elementary volume (cell) of 
a grid domain. Integrals and derivatives involved in these equations should 
be replaced by approximate difference expressions, thereby completing the 
design of a homogeneous difference scheme. The way of obtaining homoge¬ 
neous difference schemes is called the integro-interpolational method 
or balance method. 

In what follows the illustration of this method is concerned with equa¬ 
tion (1) from (Section 1) capable of describing the stationary distribution 
of temperature over a homogeneous bar 0 < x < 1. The equation of the 
heat balance can be written on the segment x i _ 1 / 2 < x < x i+1 / 7 as 

x i- 1-1/2 x i + l/2 

(11) wh-1/2 - w i+i/2 + J f(x) dx = J q(x)u(x)dx, 

x 'i- 1/2 x i- 1/2 

w = —k u , 

where w(x) is the heat flow, q(x) u(x) is the capacity of heat sinks (sources 
for q < 0) proportional to the temperature and f(x) is the distribution 
density of external heat sources (sinks). 

The existence of a heat sink owes a debt to the heat exchange with the 
external environment on the lateral surface of the bar. The quantity w i _ 1 / 2 
is equal to the amount of heat being supplied to the segment x i _ 1 / 2 < x < 
x i+i/2 through the cross-section x = x i _ 1/2 , while w i+1/2 refers in a similar 
fashion to the heat transfer from this segment through the cut x = x i+1 / 7 . 
The third member on the left-hand side of (11) reflects the amount of 
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heat being emitted on the segment [a; i _ 1 y 2 , x i+1/2 ] by heat sources with the 
distribution density /(x). The integral on the right-hand side of (11) is the 
amount of heat being transferred to the external environment by the heat 
exchange on the lateral surface. 

In order to develop a difference equation from (11), we substitute 
linear combinations of the values of u at the grid nodes in place of w and 
the integral with a that can be obtained through the interpolations in some 
neighborhood of the node x { . The simplest interpolation gives 


u = const = for x ; _ 1/(2 < x < x i+1/ , 2 


( 12 ) 


: ;+i/2 


q(x) u(x) dx fs h d i u { 


x i — 1/2 


/2 

q{x) dx , 

x i — 1 /'2 



where d t is the mean value of the function q(x) on the segment x i _ 1 j 2 < 
x < x i+lj , 2 of length h. Upon integrating the equality v! = w/k over the 
segment x i _ l < x < we arrive at 


x i~ 1 


w(x) 

k(x) 


dx , 


for which the substitution w(x) = w i _ 1 j 2 = const on the segment x i _ l < 
x < Kj yields 

x i 

f dx 

U'~ 1 ~ J k[x) ■ 

x i -1 

From what has been said above it is clear that the approximate value w i _ 1 i 2 
of the flow is 


(13) 


-cq u. T . 



dx 

k{x) 


-l 


Here f* 1 dx/k(x ) is the heat resistance of the segment 

Substituting (12) and (13) into (11) and denoting by y i the unknown 
function, we obtain the conservative difference scheme 


(14) 


1 

h {a 


*+i 


Vi +1 ~ Vi 
h 


Vi ~ Vi -1 


) - d i Vi 


-Vi 
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/here 


o / 1 f dx 
a ; = a ; : 


-l 


ds 


h J k{x) 


'-l 


k (a:, : + sh) 


(15) 


1/2 

- 1/2 

1/2 

<Pi=<Pi= j f( X i + S/1 ) ds ■ 

- 1/2 


We have written the difference equation (14) at a fixed node x = aq. With 
an arbitrarily chosen node aq it is plain to derive equation (14) at all inner 
nodes of the grid. Since at all the nodes aq, i — 1,2,. . . , N — 1, the 
coefficients a i and b i are specified by the same formulae (15), scheme (14)- 
(15) is treated as a homogeneous conservative scheme. Because of this, 
we may omit the subscript i in formulae (14)—(15) and write down an 
alternative form of scheme (14): 

(« Vs) x ~ dy = -ip . 

In the general case the coefficient cq built into the formula for the heat flow 
is some functional of the values of k{x) on the segment [x i _ 1) 

Observe that the conservation law in the entire grid domain ui h known 
as the “integral conservation law” is an algebraic corollary to equation (14) 
for any conservative scheme of the form (14) with arbitrary ingredients a, 
d and tp. Indeed, with the notation = — a i (tq — y i _ 1 )/h for the 

difference expression of the heat flow at the point x = we can 

rearrange (14) as — dq +1 / 2 -f hp i — hd i y i) which becomes after 

summation over i — 1,2,. .. , N — 1 the difference conservation heat law 
within the entire grid domain: 


TV —1 TV-l 

hd/2 — dJN-1/2 + J 2 hpi= X) dd i y i) 

i = 1 i = 1 

meaning the difference approximation of the integral conservation law for 
equation (1) from Section 1. 
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3. Homogeneous conservative schemes. In the preceding section we have 
designed the conservative scheme (14) by means of the integro-interpo- 
lational method. In the general case the coefficients a, d and <p of scheme 
(14) are some functionals of the coefficients k(x), q(x) and f(x) involved in 
the differential equation 


a(x) = A [k(x -f sh)] , 

(16) d{x) = F [q(x + sh)] , 

^( ;C / = A[/( ; r + s/i.)] . 

The domain of the pattern functional A[&(s)] is 1,1] (function k(s) £ 

Q(°)[-l, 1]), while the domain of F[/(s)] is 1/2], In other words, 

the functional A[fc(s)] (or F[/(s)]) is defined for all piecewise continuous 
functions k(s) (or f(s)) given on the segment — 1 < s < 1 (or —1/2 < s < 
1/2). In trying to recover the coefficient a(x) the intention is to use formula 
(16) with k(s) = k(x + sh). This is consistent with the passage from the 
pattern — 1 < s < 1, on which the function k(s) is defined, to the pattern 
x — h < x' < x -\- h, so that the function k(x') should provide a possibility 
of subsequent calculations of a(x). 

At the next stage we consider the homogeneous conservative scheme 


( a f/$)r ~ dy = -<p(x ), xeui h , 

(I 7 ) 

y(0) = Uj , j/(l) = u 2 , a > c t > 0 , d > 0 , 

for which the coefficients are expressed by formulae (16). Comparison of 
conservative schemes (17) or (14) with the three-point scheme of general 
form (4) from Section 1 shows that scheme (17) is governed and constructed 
in accordance with the rule b i = a i+l . We will not pursue analysis of this: 
the ideas needed to do so have been covered. 

The requirement that scheme (4) of Section 1 should be conservative 
(“divergent”) is equivalent to being self-adjoint of the appropriate difference 
operator. To make sure of it, we refer to a second-order operator 

(A y)i = a { y t _ x - c { y { + b { y i+1 

0 

in the space Qh of all grid functions y = {j/ 2 } defined on the grid u> h and 

° 

vanishing on the boundary: y 0 = y N = 0. The space is equipped with 
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_^ _| 0 

the inner product (y,v) = E;=i Vi v i^- Being elements of the space Q h , 
0 

any functions y,v E Q,h ate subject to the identity: 

TV— 1 TV-1 

E (a; 24-i ~ C 14 +b i y i+1 )v i = £ ( b i-i C-i ~ c i v i + a i+i C+i) Vi ■ 

1 izz 1 

This provides enough reason to conclude that the condition 

(Ay, v) = ( y , Av) 

0 

holds for arbitrary y,v E Qh if and only if 6 i = a i+1 , i = 1,. .. , N — 1 
(see Section 2, Chapter 1). The condition b i = a i+l for scheme (4) of 
Section 1 means that we should have B [k(x -f sh)] — A [k (x + (s + l)/i)] or 
5[&(s)] = A\k(s + 1)] for any k(s) E 1,1]. Evidently, it is possible 

only in the case when the functional A[&(s)] is independent of the values 
of k(s) on the segment 0 < s < 1. The same applies equally well to the 
functional 5[fc(s)] and the function k(s) on the segment — 1 < s < 0, so 
that 

a(x) = A[k(x -f s/i)] for — 1 < s < 0 . 

Conditions (5) of Section 1 relating to the second-order local approximation 
for the conservative scheme (17) acquire the form 


a(x + h) = C(x) + 0(E), 

h 

( 18 ) «(« + fO + <.(») =tM + 0(f[3)| 

d(x) = q(x) + 0(h 2 ), <p(x) = f(x) + 0(h 2 ), 

implying that a(x) = k(x) — 4 /?. k'(x) + 0(h 2 ) or a(x) — k(x — 4 h) + 0(h 2 ). 

In Section 3.2 the integro-mterpolational method was aimed at con¬ 
structing the homogeneous conservative scheme (16) with the coefficients 
a, d and ip of the special form (15), namely with pattern functionals such 
that 

/ o . -1 1/2 

(15') A[k(s)} = ( J ijy) , F[/(s)]= j f(s) ds . 

4-1 ' -1/2 

In this case the coefficients a, d and ip are calculated by integrating 
the functions k(x), q(x) and f(x) (see (15)). 
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In practice it is convenient to employ more simpler formulae for de¬ 
termination of a, d and <p with using the values of k, q and / at the isolated 
points. Usually a pattern consisting of one or two points permits one to 
make considerable simplifications: 

a i = k i- 1/2 = k ( x i ~ 0.5 h) (A[£(s)] = £(-0.5)) , 

(19) 

4 = ?,-. <Pi = fi (C [/»]=/( 0)) 

or 

a i — 2 ( k i + k i~ l) (A[£(s)] = 2 (£(“ 1 ) + £(0)) . 

2 k i k i __ l ( 1 1 ( 1 1 \\ 

+ k i~ 1 V (A[£(«)] ~ 2 1^(0) + £(-i) ) ) ' 

Conditions (18) are certainly true for all the schemes we have mentioned 
above. 

If the coefficient k(x) is discontinuous at the middle nodal points x = 
x i _ l j 2 and the coefficients q(x) and f{x) are discontinuous at the points x = 
x it the half-sums of the left and right limiting values have to be substituted 
into formulae (19). As a final result we get 

a i= h (K x i- 1/2 - 0) + k(xi_ 1/2 + 0)) , 

d i = ~ °) + + °)). 

Vi = I (f( x i - 0) + f( x i + 0)) . 

We note in passing that formulae (19) and some others for determination 
of the coefficients a, d and <p can be derived through the approximations to 
integrals (15) and other members 

1 J dx 1 1 J dx 1/1 1 \ 

h J k(x) k i -!/ 2 ’ h J k ( x ) 2 k i _ 1 ) 

x 'i~ 1 x i — 1 


4. A primary family of conservative schemes. We spoke above about the 
family of the homogeneous conservative schemes (17), whose description is 
connected with some class of pattern functionals A[£(s)] and C[/(s)]. For 
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convenience in analysis, it is supposed that C[/(s)] is a linear nonnegative 
functional such that 

(1) FlcJ^ + cJ^s)] = Cl F[/,(«)] + c 2 F[/ 2 (s)],-1/2<s<1/2, 
where c 1 and c, are arbitrary constants; 

(2) F[f(s)\ > 0 for /(s) > 0. 

In spite of the fact that A [&(s)] is usually a nonlinear functional (see scheme 
(15')), we may assume for the sake of simplicity that A[fc(s)] is a linear 
nonnegative functional and consider, in addition to schemes (16)—(17), those 
with the coefficient a(x) still subject to the relationship (cf. (15')) 


Conditions for the second-order approximation (18) imply some restrictions 
on the pattern functionals A[&(s)] and f[/(s)]. In preparation for this, 
plain calculations give 

(p(x) = F [f(x + sh)] = F [f(x) + shf'(x)+ 0(h 2 )} 

= f(x)F[l} + hf(x)F[s}+0(h 2 ). 

Since f(x) is taken arbitrarily, it follows from the foregoing and (18) that 
(20) F[ 1] = 1 , F[s] = 0 . 

By the same token, 

a(x) = A k(x) + s h k'(x) + | s 2 h 2 k"(x) + 0(h 3 )J 

= k(x) A[l] + h k'(x) A[s] + | h 2 k"(x) A[s 2 ] + 0(h 3 ), 
a(x + h) ■= k(x) A[l] + h k'{x) A[ 1 + s] 

+ kh 2 k"(x)A[(l+s) 2 } +0(h 3 ), 

-U = ( A [l +s]~ A[s])k\x) 

+ §/i(a[(1+s) 2 ] -A[s 2 ]Y"{x)+0{h 2 ) ) 
a(x + h) + a( x) = ^ + i h ^ + s] + A[s] ) k>{x) + 0 ( h 2y 
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Comparision of the resulting expansions with (18) permits us to assign the 
values 

(21) A[l] = l, A[s] = -\ 

by virtue of the relations 

A[l + s] + A[s] = A[l] + 2 A[s] = 0 , 

A[(l + s) 2 ] - A[s 2 ] = A[(l + s) 2 - s 2 ] = A[1 + 2s] 

= A[l] + 2A[s] = 0. 

To decide for yourself whether conditions (18) related to schemes (17), 
(15') are met or not, we should take into account that 

a(x + h)± a(x) = ci(x) a{x + h) l —± 1 ) , 

y a{x) ct(x + h) J 


1/1 1 

2 \ a(x -j- h) a(x) 


1 

k(x) 


+ 0(h 2 ), 


l -(-± _ -) = ( — 

h \a(x + h) a(x) I \k(x) 

a(x) a(x -f h) = k 2 (x) + Oih 2 ) . 

We contrived to do it and give an answer to this question. When this is 
the case, the functional A[£(s)] also satisfies conditions (21). As far as the 
functionals 

F[m] = f /(s) ds, A [/(s)] = / f\s) d.s 
- 1/2 -1 

are concerned, we thus have 
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provided conditions (20)—(21) hold. 

In what follows we deal everywhere with the primary family of ho¬ 
mogeneous conservative schemes (16), (17) and (16'), (17) as well as with 
linear nonnegative pattern functionals A[fc(s)] and F[f(s)] still subject to 
conditions (20) and (21) of second-order approximation. 

In the sequel scheme (17), (15) will be called the best possible. 


3.3 CONVERGENCE AND ACCURACY OF HOMOGENEOUS 
CONSERVATIVE SCHEMES 

1. The error of approximation in the class of smooth coefficients. The main 
point of the theory is the accurate account of the accuracy of the uniform 
scheme (16)—(17) in the class of continuous and discontinuous functions 
k(x), q(x) and f(x). In preparation for this, let u{x) be an exact solution 
of the original problem 


(k(x) u'(x))' - q(x) u(x) = —f{x) , 0 < x < 1 , 

(1) 

u(0) = Uj , «(1) = u 2 , k(x) > Cj > 0 , q(x) > 0 , 

and let y = y{x) be a solution of the difference problem 


{ a Vs) x ~ d ( x ) V = ~F( X ), x = ih, i = 1,2,... , N — 1 , 

( 2 ) 

Vo = U 1 . Vn = u 7 . a ( x ) > C 1 > 0 , d{x) > 0 , 

which belongs to the primary family of conservative schemes designed in 
Section 2.4. 

Common practice involves the error z{x) = y{x) — u{x) being a grid 
function for x £ ui h . Inserting the representation y{x) — z(x) + u{x) in (2) 
and assuming u(x)' to be a known function, we may set up the difference 
problem for the error 


A z — (az s ) — d z — —ip(x), x — ih , i — 1,2,... , N — 1 , 

( 3 ) 

z(0) = z( 1) = 0 , a > Cj > 0 , d > 0 , 


where the residual 

(4) '*/'(*) = A u + <p(x) = (au s ) — du + <p 
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is the error of approximation of equation (1) by the difference scheme (2) 
on the solution u =■ u{x) of problem (1). 

In Section 1.4 we have established conditions of the second-order lo¬ 
cal approximation for the conservative scheme (2) with linear nonnegative 
pattern functionals A[^(s) ] and F[/(s)] such as: 

(5) A[l] = l, A[s] = -±, F[l] = l, F[s} = 0. 

As can readily be observed, these conditions remain valid for any scheme 
from the primary family. 

In order to evaluate the order of accuracy for scheme (2), it is necessary 
to make the accurate account of the error z = y — u being viewed as a solu¬ 
tion of problem (3). Moreover, the desirable estimate should be expressed 
in terms of the right-hand side ip. In this direction the error of approxi¬ 
mation to 'ip(x) is considered first. If k(x) £ C E and q(x),f(x) £ C^ 2 \ 
then 

ip(x) = A u + (p - ( Lu + f) 

= [( au e) x ~ ( ku 'Y ] ~ {d-q)u + (ip- f) - 0{h 2 ). 

This means that scheme (2) provides a local approximation of order 2, so 
that || tp < Mh 2 , where M = const > 0 is independent of h. 

In the sequel we succeed in showing that 

IIEL = E h E h ^k < M h2 

i' = l k = 1 

if k(x), q(x), f{x) £ C'( 2 \ meaning that k(x) possesses two (but not three) 
continuous derivatives. 

2. The error of approximation in the class of discontinuous coefficients. 

Our aim here is to justify that the error of approximation (4) can always 
be represented in the form 


(6) 

tp -rj x A tp*, 


(7) 

"3 

1 

,li 

! —1/2 ’ 

(8) 

11 

EE 

1 

1 

~to ^ 

j + sh) ds'j 


1/2 

- ( d i u i J 
-1/2 

q(x i + sh) u{x i + sh) ds 
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This can be done with the aid of the balance equation upon integrating 
equation (1) over x from x i _ 1 j 2 to x i+l j 2 \ 

x i + l/2 x i + l/2 

^ [(ku')i +1/2 -(A;u')i_ 1/2 ] J q(x)u(x)dx + ^ J f{x) dx = 0. 

x i~ 1/2 x i- 1/2 

With the new variable s = (x — x^/h, the balance equation becomes 
1/2 1/2 

((A;u , ) t _ 1/2 ) i , - J q(x i + sh) u(x i + sh) ds + J f{x i + sh) ds = 0 . 


Upon subtracting the last equation from (4) we establish formulae (6)-(8) 
and deduce that if k(x), q{x ), f(x) G C^ 2 \ then 

(9) % = o{h 2 ), = o{h 2 ). 

For this, we proceed as usual. What is available are the useful expansions 

1 h 2 

u i = — 1/2 + 2 h u> i-i /2 + ~g~ u "~i /2 + 0(h 3 ) , 

1 h 2 

U l-1 = U i- 1/2 - 2 ^ U 'i-U2 + ~g~ u 'i- 1/2 + > 

= U 'i-U2 + 0 ( h2 )’ 

ft = («; ~ ^-i /2 ) w-_ 1/2 + 0(/i 2 ) = 0(/i 2 ) , 
which emerge from the chain of the relations 

«i = ^4+ s/i)] = A[/c(aq_ 1/2 + (s + |) /*)] 

— ^4 [&j_i/ 2 + h ^.;_ 1 / 2 ( s + |) + 0(/i 2 )] 

= k { _ j /2 + h k' i _ ll2 A[s + |] + 0(/i 2 ) = &j_i/ 2 + 0(h 2 ). 

A simple observation that for any ti(x) G C^ 2 ) 


ii t 

J v(x i + sh) ds = + 0{h 2 ) 



162 


Homogeneous Difference Schemes 


helps motivate what is done with ip* = (q i w,- — dj rq) -f (ip i — / t -) -f 0(h 2 ) = 

0(h 2 ). 

We now turn to the case of discontinuity coefficients k(x), q(x) and 
f(x) and assume without loss of generality that k, q and / have disconti¬ 
nuities of the first kind only at a single point x = £ £ (0, 1), so that 

£ = x n + 9h , 0 < 9 = 9(h) < 1 , 0 < n < N . 

The solution u = u(x) to equation (1) for x = £ satisfies the continuity 
conditions for the function u(x) and the flow k(x)u'(x): 

[u] = u(£ + 0) — u(£ — 0) = 0 , [ku'] = 0 for x = £ . 

Under the assumptions k(x), q(x), f(x) £ Q0) we thus have u(x) £ Q( 3 \ 
Before going further, it is straightforward to verify for % that 

%=(«%),-- = °( h2 ) for a11 + 

In dealing with Jj n+1 = a n+J u s n+J — ( ku') n+1 / 7 we make use of the expan¬ 
sions in a neighborhood of the point x = £: 

u n + l = u (£) + (1 ~~ 0) ^ ll> (£, + 0) + - - — h 2 u" (Jp + 0) + 0(h 3 ), 

9 2 

u n = u (£) - Oh u '{£, - 0) + Y h 2 u"(p - o) -I- 0(h 3 ), 

r (ku') x=e+ o + (0.5 -9)h (*«% = e+o + 0(h 2 ) for 9 < 0.5, 
{ku') n + 1/ 2 = < 

( (ku') x= ^ 0 + (°-5 — 9) h {ku l ) l x= ^_ Q + 0(h 2 ) for 9 > 0.5, 

by means of which an alternative form of writing r] n+1 can be re-ordered 
for later use: 

Vn +1 = a n +1 ((! - 6 ) “right + ^ieft) ~ W o + 0(h) , 

where w 0 = (ku') r i ght = (ku')] e n, Ueft = “(£ ~ °) and Uight = v (£ + °)- 

At the same time, the continuity condition [ku'] — 0 assures us of the 
validity of the relations 


( 1 - 0 )' 


right 


left 


‘'left 


1 -1 


''right 


Vn +1 


n + 1 


‘'left 


1-61 

U 

"-right 


- 1 


w 0 + 0(h) 
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It seems worthwhile to focus the reader’s attention on the best scheme 
(15) from Section 2 for which the chain of the relations occurs: 


ds 


ds 


a ,, J k ( x n+ 1 + sh) J k(x n + sh) 

n+! _1 0 


ds 


ds 


k(x n + sh) J k(x n + sh) 


+ J {k^ + ( ‘~ e)h '(ll^ +oih2) ) ds 


T~ + ir 1 + 0( ' ,) - 

^ left Sight 


so that i] n+1 = V n+ i = 0(h). For all other schemes r/ n+1 = 0(1). 

In the estimation of ip* it is necessary to distinguish two possibilities 
of interest: 6 < 0.5 and 9 > 0.5. 

(1) Let 9 < 0.5. In every such case ip* = 0(h 2 ) for i ^ n, while 

0 0 

?/)* = 0(1) and only for the best scheme with ip^ = P i and d { = di 
o 1/2 

incorporated ip* = f q(x { + sh) (■u(x i + sh) — u t ) ds = 0(h) 
-1/2 

is attained for i = n, since u(x n + sh) = u(p) + 0(h) for any 
s G [-0.5, 0.5], 


(2) If 9 > 0.5, then ip* — 0(h 2 ) for i ^ n -f 1, while ip* +1 — 0(1) and 

k +1 = °( h )■ 
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It follows from the foregoing that 


( 10 ) 


Vi = 

-- 0(h 2 ) 

for 

i ^ n - 1-1, 

??„ +1 = 0(1), 


= 0(h 2 ) 

for 

* 7^ n, ip* n 

= 0(1), 

0 

€ 

= 0(h) 

if 

^ < 0.5, 


V : 

= 0(h 2 ) 

for 

i z/z. n -f- 1, 

K +1 = o(i) 

k +1 = 0(h) 

if 

9 > 0.5. 



Using these estimates behind we draw the conclusion that at the nodes 
x = x n and x = x n+1 the function ip{x) can be expressed by 

( 11 ) ^ n = ^±1 + 0 ( 1 ), ^ +1 = -^- + 0(l), Tj n+1 = 0 ( 1 ), 

thereby clarifying that at the nodes adjacent to the discontinuity point 
x = £ scheme (2) does not approximate equation (1) in light of the limit 
relations 


^ = °( K J l ^ ^ °° > ^n+1 = O 

as h —>■ 0. From asymptotic formulae (11) it is readily seen that the main 
summands in the expressions for ip n and 4’n+i have equal modules and 
opposite signs, so that 

1p n + 4’n + l ~ 0(1), h(4> n +4> n + 1 ) = 0(h), 

meaning that the error of approximation is of dipole character in neighbor¬ 
hoods of discontinuity points of the coefficient k(x). This provides enough 
reason to conclude that the conservative scheme (2) is of order 1 in the 
norm 

Ill’ll* = (!. M] + (1, M] = 0(h) 

with [i { = htf’l for i = 2, 3, .. . ,N and n l = 0. 

3. A priori estimates of the error. We now estimate the error z = y — u, 
which is a solution of problem (3): 



A z = (az s ) — dz = —ip(x), 0 < x — ih < 1, z(0) = z(l) = 0 , 
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where ip(x) is the error of approximation having the form (6): ip = r) x + ip*. 
We will show that the solution of problem (3) with the right-hand side (6) 
admits the estimate 

( 12 ) Ik lie = \\v~ u Wc < pr ((!. I 7 ?!] + ( 1 > I A* I ]) . 

C 1 

where f.i t = Y^ k = \ h tf’l for i = 2,3 ,N and ^ = 0. To that end, it 
suffices to carry out the proper evaluation of a solution of the auxiliary 
problem 

(13) At; = (av s ) x - dv = -rj x , t;(0) = t;(l) = 0 . 

Other ideas are connected with solving the difference problem 

= ~ri x . t«(0) = w(l) = 0 , 

from which follows immediately that awg+r/ = const = c 0 . As its corollary, 
we establish the recurrence relation for u> k : 

h Vk , hC 0 L _ 1 0 AT 

w k~ w k~ i “ b “ ) k — l,2,...,N. 

a k a k 

Summation over k from 1 to i yields 

vk h Tlk . . vk /t 

w i ~ w o ~ 2^ ~a -b c 0 A i , A = 2_^ — . 

k = 1 k k = 1 Ck 

Putting i = N and keeping in mind that w 0 = w N = 0, we find that 

i N i 

— JL 1 ^ k 

a n a k 


yielding 


l J\ 

y- h rj k Ai~ h i] k 

cti. An Cli. 

k -1 L JV k -1 K 


y^ h Tj k A_ sr' n Vk 


a k An 
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As far as A t < Ajv, the preceding decomposition implies that 


I w i I < (l 


Aj N h\ri k \ 

An ’ h ak 


A 

An 


N 


E 


h \jlk\ 

a k 


N 




h I Vk I 

a k 


< ~ (1, \v\] ■ 

Cl 


The difference ^ = v i — wq, solving the problem 

{ a £,x) 3 .- d t = dw, £(0) = £(1)=0, 

with a > Cj > 0 and d > 0, is aimed at the further estimation of v i in 
complete agreement with the lemma from Chapter 1, Section 2.8. The 
results of this section provide support for the view that. ||£|| c < ||w|| c 
and, therefore, 


MIc < IMI c + ll£ll c ^ 2 


C-i 


Summarizing, we arrive at 

(14) lhll c <-(l,hl]. 

^ C 
L 1 

The function ip* is representable by 

(15) 

where /q = for i = 2,3,... , N and /j, 1 = 0. Because of this 

form, it is possible to write down = (77 + /i) r and involve estimate (14) 
in subsequent reasonings: 

IUII c <r(i.h? + ffl]<r(( 1 ’l ? iA(i,lff|]). 

c i c i 

4. On convergence and accuracy. The results obtained in the preceding two 
sections may be of help in establishing the rate of convergence for scheme 
( 2 ). 
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Theorem 1 The accuracy of any scheme (2) with coefficients (16) is of 
order 2 in the class of smooth coefficients k(x), q(x), f(x) £ C^ 2 ^[0, 1]: 

II y- u\\ c < M h 2 

with constant M > 0 independent of h, whereas it is of order 1 in the class 
of discontinuity coefficients k(x), q(x), f(x) £ 1]: 

\\y-u\\ c < M h . 

The best scheme also has the second-order accuracy in the class of discon¬ 
tinuity coefficients. 

These assertions follow from the representation of the approximation 
error in the form (6)-(8) and a priori estimate (12), On the basis of the 
estimates for and t />? obtained in Section 3,2 we find that 

(16) (1, | rj\] = h |?? n+ i | + 0(h 2 ), 

Pt = 0(h 2 ) for i < n , 
ffi- h (^n+^n+i)+0(h 2 ) for i>n + 1, 

yielding 

(17) (1.1 A* I] = h\ip* n + ip* n+1 I (1 - x n ) + 0(h 2 ) . 

Combination of relations (16)—(17) just established and estimate (12) pro¬ 
vides the sufficient background for the validity of the assertions of the the¬ 
orem in light of the asymptotic representations 

€ + r n+1 = o( i), 

C + C+i = °( h ) for an y 0 e [o, i], 

Vn+i=0(l), v n+1 =0(h). 

In the case of smooth coefficients we achieve for any admissible scheme 
T/f = 0(h 2 ) and tpi = 0(h 2 ) for all i = 1,2,,,. ,jV — 1 and, therefore, 
(1,1 V|] + (1, \ff |] = 0(h 2 ). 

Remark It can be shown that the approximation in the class of smooth co¬ 
efficients is necessary and sufficient for the convergence of the homogeneous 
scheme (2), 
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3.4 HOMOGENEOUS DIFFERENCE SCHEMES ON 
NON-EQUIDISTANT GRIDS 


1. Schemes on non-equidistant grids. Quite often, in practical implementa¬ 
tions difference schemes on non-equidistant grids are in common usage for 
solving differential equations. In Chapter 2, Section 1 we have produced for 
the simplest equation u" = — f a difference scheme on the non-equidistant 
grid 


Uh. = 


i- 0,1,... ,N, 


0, 


- N 


1, h: = 


and have determined for this scheme the error of approximation. 

In order to develop a homogeneous conservative scheme on the non- 
equidistant grid oj h , we write down the balance equation 


x i+ 1/2 


+ 1/2 


(!) w ;-i /2 - ud+i /2 - / q{x)u(x)dx 


/(x) dx, w = —ku\ 


x i~\j2 


x i~ 1/2 


on the interval (x i _ 1 ^ 2 , aq +Jj , 2 ) with the ends x i _ l j 2 = x i — 0.5 h i and 
x i+lj , 2 = x i + 0.5 h i+l . By analogy with Section 2.2 the forthcoming sub¬ 
stitutions 


c t +1/2 x i + l!2 

f 0 o 1 f 

/ qu dx ~ /q di U { , di — / q{x) dx , 


l i~ 1/2 


• x i~ 1/2 


h = \ (hi + h i+ !), 


0 U; — U,- 


u i~l/2 ~ w i-l/2 — a i h 


- a i U Si > 


o ( 1 f dx 

ai = [h'i J W) 


Xi 


■ 1 
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lead to the difference scheme 

( 2 ) 


1 

H: 


o y i+ i -y t o yi~ y i ^ l 

“ i+I h- h 

'h-M n l 


0 1 
a; = u 


dx 

k(x) 


di y% c ?' t 

-i + l/2 


1 


q(x) dx . 


H-l/2 


r t + l/2 


^ = 


f(x)dx , 


r Z —1/2 


which is the best possible in the same sense as we spoke above about this 

on an equidistant grid. On the same grounds as before, the coefficients () 
0 0 

di and ‘Pj are representable by 


d-s 


k{ Xi + shi) 


( 3 ) 


° h 11,2 

d t = Y J q(xi + sh^ ds H J q{x { + sh i+i ) ds , 


- 1/2 

0 


0 1/2 

Vi = ^ J f( x i + sh i) ds + J f( x i + s/ h+i) 
* - 1/2 1 0 

Retaining the notations of Chapter 2, Section 1 

Vi ~Vi -1 


ds , 


- ~ & , _ %+i ~ Vi 

d x , /’ i > di: i t 

' I t + 1 n i 


which allow a simpler writing of the ensuing formulae, we refer to the three- 
point scheme 


( 4 ) 


(ay^i - dy = -<p , 


x = Xi <ECj h , 


2 /( 0 ) =■ Uj , j/(l) = u 2 , a > Cj > 0, d > 0 


ao 
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When the available functions k(x), q(x) and f{x) happen to be of the class 
Q (0) [o,i] and their discontinuity points are known, a non-equidistant grid 
can be made so that all discontinuity points of the coefficients k, q and 
/ would be nodal points of such a grid. We denote by ui h (K) any such 
grid depending on concrete functions k, q and / and arising in subsequent 
discussions. It is easily seen from (3) that the simplest expressions for cq, 
d { and <p i on Cj h {K) are given by 


(5) cq _ rx, i _ 1 j 7 , 


hi q- 

h rl — 1 

1/2 , o-i — 

where jf = /(aq ± 0), etc. 


i+i ?i 


2 h. 


Vi = 


hjf j +h i+1 f+ 
2 H: 


i - \ i k t- 1 + k i ). 

hi 1i-\j 2 + h i + 1 </j_|_!/2 


d; = 


2 hi 


Vi 


2k+ , k~ 

2 — 1 l 

k t-i + K 


hj /* —1/2 + k i + 1 


' 2+1 *'2 + 1/2 


2 h 


In the case of continuous coefficients expressions (5) imply that cq = k i _ i j 2 , 
d{ = q t and <pf = / 8 -. If discontinuity points coincide with nodal points of 
the grid + , that is, x = x i _ l j 2 , then the members cq, d { and <p i can be 
found in simplified form: 


(5') 


2 kj k i _ l 

k i + k i -1 


1i 


Vi 


fi 


2 +_ i / 2 +_ i /2 


u+ 

*■1-1/2 


■k~ 


Vi = 


i- 1/2 

h l+i q- +1/2 +h t q+_ 1/2 

2 h 

hi + 1 /»• + 1/2 ” 1 “ k i ft- 1/2 

2 ~hi 


2. The error of approximation. We now investigate the error of approx¬ 
imation for scheme (4) on the non-equidistant grid Cj h by considering the 
equation for the error z = y — u: 


( 6 ) 


(a%).i ~dz- -rjj(x) , x £ ui h , 
z 0 ~ Z N ~ 0 > a — c i > 0 i d > 0 , 



Homogeneous difference schemes on non-equidistant grids 


171 


where ip(x) = ( au s )$ — du + <p(x) i s the error of approximation. 

On account of the balance equation (1) the error of approximation 1 /q 
reduces to 

Tpi = V£,i + i’h Vi = (a%)i “ (ku')i- 1/2 , 

where 

x i+ 1/2 

0 1 f 

(7) i>* = {ipi - <P { ) - d t Ui + — J q(x) u(x) dx . 

x i- 1/2 

In what follows the functions k, q and / will be smooth for x i _ 1 < 
x < x i and x { < x < x i+l and possess discontinuities of the first kind at a 
single node aq. Combination of the expansions 

f(x i + sh t ) = /j_ 0 + s ht /f_ 0 + 0(h?) 


for s < 0 and f(x { + s /q) = f i+0 + s h i+l f' i+Q + 0(/i 2 +1 ) for s > 0 with 
0 

formula (3) for ^ gives 

\ fi-0 + ^s'+i fi+O 1/2 \ 


‘Pi = 


2 H: 


0(hl 


Likewise, 
x i + 1/2 

i j , w «w*= 2Sj 

x i-l/2 


hi di-o + h i+1 q i+Q /h. (?«)■_!/ 


. + 0(/i 2 ). 


With the relations a ; = k i _ 1 i 2 and u s ; in view, we deduce 

from the foregoing that for the scheme with coefficients (5) 

(8) ' A = (v + fi) £ii + '/>?, 

whose ingredients behave as follows: 

c = > 

hf (qu — fY i _ 1 i 2 9 

j j /j —1/2 _ n ,,2 


( 9 ) 


7; 


= 0(h), 


Vi = a r - (ku')i^ 1/2 = 0(/i 2 ). 
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3. The order of accuracy on non-equidistant grids. As before, the inner 
products are defined by 

TV — 1 TV 

(y, ^)* = E Vi v i h i . ^]* = E Vi v i h i ■ 

*=i *=i 


For problem (6) with the right-hand side (8) the estimate 

(10) || z 

l c < ^-{(i-M + K?|] + (i,M]} 

is valid with /r 

i = E h 'PI for f = 2, 3,... ,N and = 0. 

k~l 


The derivation of this estimate coincides with that of inequality (12) 
carried out in Section 3 by inserting a i /h i in place of cq//i. 

In light of the asymptotic relations (9) estimate (10) implies that if 
k, q, f £ <2( 2 )[0, 1], then scheme (4)-(5) is of second-order accuracy on the 
sequence of non-equidistant grids ui h (K): 

II^lie = \\y- u \\ c < M h 2 , 

where h = \J (1, h 2 ] is the mean square step. 

When only one coefficient k(x) £ Q is discontinuous, while other 
coefficients q, f £ C^ are continuous, any conservative scheme (4) gen¬ 
erating a second-order approximation is of second-order accuracy on the 
sequence of non-equidistant grids u> h (K). This fact is an immediate impli¬ 
cation of the expansions 77 ,- = a ^ u ^. i — (k u , ),'_ 1 / 2 = 0(/i 2 ), valid for the 
aforementioned schemes, and ip* = O(hP). 

We are now interested in the question concerning the accuracy of 
scheme (4) with second-order approximation on an arbitrary non-equidis¬ 
tant grid. A discontinuity point x = £ is free to be chosen for the relevant 
coefficients: 


x n < £ < x n + l , Z = Xn + Sh , 0 < 6 < 1 . 

Being concerned with ip* specified by (7) and involved in the representations 

'Pi = V&,i + 'Pi , Vi = («%), - {ku')i- in , 
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which are always valid, we follow the same procedures in the accuracy 
analysis as we did on equidistant grids in Section 3. This amounts to 
regarding q, f £ C^ to be continuous and establishing the relations: 

= 0(h . 2 ) for i^n+1, rj n+1 = 0(1) . 


Only for the best scheme (3) we might achieve i] n+l = 0(/i n+1 ) and 


Vi. 


p 




/2 


P* = 0(%) 


for all i = 1,2,... ,7V— 1. 

Using estimate (10) behind we deduce that the best scheme (3)-(4) 
retains the second-order accuracy in the class of discontinuous coefficients 
on an arbitrary sequence of non-equidistant grids, while any scheme (4) 
appears to be of order 1. 


In the class of continuous coefficients k, q, f £ C^ 2 ^[0,1] any 
scheme (4) retains the second-order accuracy on an arbitrary 
sequence of non-equidistant grids. 


Before we undertake the proof of the last assertion, it is worth men¬ 
tioning the estimate obtained in Chapter 2, Section 4 for the operator 
equation A z = ip\ 


IML = imu- < 7 11^11 = -! > 

0 0 0 

where A > c 1 A, A = A* > 0 and A — A* >0. In the case of interest 

, o 0 

Ay = -{ay s ). + dy, Ay = -y s3; , yen, 

0 

where Q = H is the space of grid functions defined on u> h and vanishing 

for i — 0,7V. The negative norm ||^||o_ was estimated in Chapter 2, 

A 

Section 4 as follows: 

Ill’ll" i < IMI + \\v]\+ || 7 «]| = Oih 2 ). 

A 

Here h 2 denotes, as usual, the mean square of h'j and so the desired assertion 
follows immediately from the preceding. 
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4. A greater gain in accuracy on a sequence of grids. The Runge method. 

In a common setting we are dealing with a linear mathematical-physics 
equation 

(11) Lu - f{x ), ifG, 

regardless of additional conditions on the boundary T. Let ui h be a grid in 
the domain G with step h, by means of which a difference scheme 

(12) L h u h =f(x), x(Euj h , 

can be put in correspondence with problem (11). 

When this scheme happens to be stable, so that 
with a positive constant M independent of h (see Chapter 2, Section 2), 
the approximation implies the convergence 

( 13 ) II Vh ~ u h II( U) < M ll^ll( 2)l ). 

where tp h = <p h - L h u h - (<p h - f h ) - (L h u h - ( Lu) h ) is the error of 
approximation (residual) on the problem (11) solution u = u(x). It is 
readily seen from (13) that the order of accuracy is not lower than the order 
of approximation and the behaviour of the residual || ip h ||^ ^ = 0(h n ) is a 
corollary to the estimate for the relevant deviation || y h — u h ||( lh ) — 0{h n ). 

In order to improve the accuracy of the approximate solution, it is 
necessary to diminish the grid step h or make the approximation order 
n of the scheme higher. An elementary example illustrating how to raise 
the order of approximation on a solution is available in Chapter 1, Sec¬ 
tion 2.2. However, in trying to develop higher-accuracy schemes for many 
problems, especially for equations with variable coefficients, considerable 
obstacles of technical character do arise. Moreover, the transition to such 
schemes except the schemes for the heat conduction equation with constant 
coefficients and the Laplace equation which will be given special investiga¬ 
tion in Chapters 4—5, should cause the essential growth of the volume of 
computations. 

The gain in accuracy provided by refining the step h is limited by 
requirements of economy. Such an approach is equivalent to minimizing the 
execution time necessary in this connection in obtaining the solution. But 
if the solution of the original problem u and / both are smooth functions 
of x , the accuracy of numerical solution can be increased by performing 
calculations for the same problem (12) on a sequence of grids u> h , . . . , u> hn . 

In the sequel we assume that u = u(x) possesses all necessary deriva¬ 
tives which do arise in the further development. In order to understand 
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this approach a little better, we consider the simplest case, provided that 
the asymptotic expansion 

(14) Vhi. x ) — u h{ x ) + a i( x ) h kl + 0(h k2 ) , k 2 > k 1 > 0 , 

holds, where « 1 (k) does not depend on h. In such a setting it is required 
to find a grid function y h (x) satisfying the relation 

(15) y h (x) = u h (x) + 0{h k2 ). 

The traditional way of covering this is to introduce two grids ui h and ui h 
with steps h 1 and h 2 and common nodes, the set of which is denoted by 
ui h , and to form the grid function 

(16) y h (x) = Cl y hi (x) + c 2 y h2 (x), x <E w h , 

while Cj and c 2 remain as yet unknown. Substitution of expansions (14) for 
V hl and Vh 2 into ( 16 ) gives 

Vh{ x ) - ( c i + c 2 )u h ( x ) + (c a /if 1 + c 2 h^ 1 ) a 1 (x) + 0(h k2 ) , 
whence it follows that y h — u h = 0{h k ' 2 ) if 

Ci -(- C 2 — 1 , Ci h i 1 c 2 h kl ~ 0 . 

This is certainly so with 


(17) 



In particular, keeping h 1 = h and h 2 — | h, we find ui h = co h and Cj = 

— 1 /( 2* 1 - 1 ). 

Thus, the improved accuracy of a grid solution on some set of nodes 
ui h is connected with solving problem (12) twice (first on the grid u> h and 
then on the grid ui h2 ) and drawing up the linear combination (16) with 
coefficients (17). The grids ui h and w h2 are chosen so that their intersection 
coincides with ui h . For instance, by applying a scheme of second-order 
accuracy satisfying the relation 


y h ( x ) = u h( x ) + a i h 2 + 0 (h A ) 
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and having k 1 = 2 and k 2 = 4 to the difference problem with steps h 1 = h 
and h 2 = | h we calculate the solutions y h and y h j 2 and the coefficients 
Cj = — i and c 2 = leading to the function in question: 

fl ( x ) = I Vh/2 ~ 3 Vti > 

which is defined on the grid u> h and approximates the exact solution u(x) 
with accuracy 0(/i 4 ): 


Vh = u h + °( hA ) fOT ifwi' 

One way of proceeding is to take for granted the expansion 

yh — u^ ct 3 (x^ h 1 ct 2 (^x^ h ' 2 0(Ji 3 ), k 3 k 2 k 3 t>0, 

where the functions aq(a;) and a 2 (x) are independent of h. Because of 
this, we must solve the difference problem concerned three times with steps 
h i: h 2 and h 3 , respectively, in an attempt to obtain a solution with the 
prescribed accuracy 0(h kz ). In what follows y hi (x), J/^ 2 (*) and y^^x) will 
stand for the appropriate solutions. Also, it will be sensible to introduce 
their linear combination 


Vh { x ) = c i Vh 1 ( x ) + C 2 Vh 2 ( x ) + c s Vh 3 ( x ) > x £ u h 


As before, the grid ui h is the intersection of the three grids ui h , ui h2 and 
ui h3 . In particular, ui h = ui h under the agreements h 3 = h, h 2 = |/i and 
h 3 = i/i. When the approximation y h = u h -f- 0(h kl ) is accepted for later 
use, the following equations 


C 3 — 1 > 


A ^+< 


• /r 1 
2 n 2 


„ h kl — 0 

-3 ll 3 ~ U : 


Cj h k L 2 +c 2 h 2 2 +c 3 h k 3 2 = 0 


constitute the system for finding the coefficients eq, c 2 , c 3 . Evidently, the 
determinant of this system is nonzero. 

In the general case the expansion of the error y h — u h in powers of h 
is of the form 


n- 1 

(18) y h = u h + ]T a s (x)h s + a n (x,h)h n , 

s = 1 

where a s (x), s = 1,2, . .. , n— 1, are independent of h and the absolute value 
of a n (x, h) is bounded by a constant M = const > 0, which is independent 
of h. Our next step is to establish an a priori expansion of the form (18). 
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When u(x), f(x) and the coefficients of equation (11) are smooth enough, 
the expression for the error of approximation '<Ph( x ) is simple to follow: 


(19) 


n- 1 

i>hi. X ) = Ps( X ) hS + Pn( x > h ) hn , 

s = 1 


where P s (x), 1 < s < n — 1, are independent of h and \j3 n {xji)\ < M, 
M = const > 0 is also independent of h. From such reasoning it seems 
clear that any sufficiently smooth function a s (x) admits the representation 


n — 1 

(20) L h a s (x) = La s (x) + u h + Y^ 7s ( x ) + 7 n ( x , h ) ^• 

5 = 1 

In this view, it is not unreasonable to attempt the difference y h — u h 
in the form (18). Applying the operator Lh to identity (18) yields 

n— 1 

Lh ( y h ~ U h) = Yl Lh a ^ hS + La n( x > h ) hn ■ 

5 = 1 

Using the relation Lh(y h — u h ) — an d formula (20) for L/jOq, we arrive 
at 

n — 1 s — 1 

Lh{y h - u h ) + h m ) h 5 + 0(h n ), 

5 = 1 m = 1 

giving 

n— 1 5—1 

( 21 ) 4 = hm ) hS + o{h n ). 

s = l m-1 

Comparison of formulae (19) and (20) justifies the validity of expansion 
(18) if functions a^(x) are solutions to the equations 

s — l 

La s = P s (x) - 7m( x ) for s = 1,2,... , n - 1 . 

m = 1 


Observe that expansion (19) is not obliged to contain all of the powers of 
h, some of them may be omitted. In this case the appropriate coefficient 
equals j3 s = 0. 

Adaptive grids may be of assistance in raising the order of accuracy 
without increasing the total number of nodes. If the subsidiary information 
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on the behaviour of the solution of an original problem is available, a grid 
can be made so as to achieve a prescribed accuracy at minimum nodal 
points and, therefore, in a minimal number of the necessary operations. 
For instance, successive grid refinement will be appreciated in the region of 
widely varying coefficients and the right-hand side. Specifically, near the 
point (the line) of discontinuity of coefficients, representing the boundary 
between two media, the grid is refined in such a. way to attain the minimum 
of the step near the boundary. After that, the step is being enlarged for 
instance, as a geometric progression in moving from the boundary. When no 
information about the behaviour of the solution is available, a preliminary 
computation proves to be useful on a sparse grid, after which we are working 
on a new grid with a more smaller step in the regions with large deviations 
of the solution. In practice non-equidistant grids are widely used. As 
shown in Section 3, it is possible to construct special grids uj h (K) so that 
all discontinuity points of the coefficient k(x) involved in the equation 

(k(x) u — q(x) u = —f{x) 

fall into nodal points of the grid Cj h (K). Under such a choice, any ho¬ 
mogeneous difference scheme (ay%) £ — dy = —p> generating approximation 
of order 2 (in the class of smooth coefficients) is of second-order accuracy 
in the class of discontinuity coefficients k(x). The accuracy of difference 
schemes, which depends on the existing grids suitable to computer calcu¬ 
lations for equations with variable coefficients, needs investigation for each 
concrete problem. 


3.5 OTHER PROBLEMS 

1. The third boundary-value problem. The main goal of our studies is 
a homogeneous difference scheme for the boundary-value problem of the 
third kind: 


Lu — ( k(x)u')' — q{x) u. = — f(x), 

0 < x < 1 , k(x) > Cj > 0, q > 0 , 

(1) 

k( 0) u'(0) = /?j u(0) — /ij , —fc( 1) u\ 1) = A u{ 1) — p 2 , 

A > o, A > o, A + A > o. 

We approximate equation (1) in the usual way: 

(2) A y = -ip(x), A y = (ay s ) x -dy, a > Cj > 0, d> 0, 
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where a, d and f satisfy the approximation conditions (18) of Section 2. 

First, we consider the simplest approximation of the boundary con¬ 
dition at the point x = O'. a 1 y s j = fd l y 0 — and calculate the error of 
approximation by inserting y — z + u: 

«i %,i = A z o “ a i %,i - A«o+Cr 


We obtain 

= ( k o K ~ A u o + /-h) + 5 h ( k u ')o + °( h2 ) -\ k ( k u')' 0 + 0(/i 2 ) 
through the approximations 

a i = + 2 ^ + <3(/l 2 ), 1 " M o + 2 ^ U o + 0(/l 2 ) • 

Substituting here. ( ku ')( = q 0 u 0 — /„ emerged from equation (1) we find 
that 

-\h(q 0 u 0 - /o) + 0(h 2 ), 
thereby justifying that the boundary condition 

( 3 ) cq ftiVo Ah > /^i /^i d - 2 ^ ) Ah — Ah d“ 2 

provides an approximation of order 2 on the solution u(x) of problem (1). 
In a similar manner we derive the difference boundary condition of second- 
order approximation at the point x = 1: 

(4) — a N y sN = f3 2 y N — p, 2 , j3 2 = (3 2 + k h q N , fi 2 = y 2 -f | h f N . 

In this way, the third kind difference boundary-value problem (2)-(4) of 
second-order approximation on the solution of the original problem is put 
in correspondence with the original problem (1). 

2. A problem with periodicity conditions. First, we study the elementary 
problem in which it is required to find on the segment 0 < x < 1 a solution 
to the equation 

(5) u"(x) — q 0 u — —fix), q 0 = const >0, 0 < x < 1 , 

satisfying the condition of periodicity 

(6) u(x + 1) = u(x) for all x £ (0, 1) . 

Here f(x) is a periodic function of period 1: f[x + 1) = f(x). 
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At any point x £ (0, 1) condition (6) is equivalent to the pair of 
continuity conditions at the single point x = 0: 

(7) u(0 + 0) = u(l — 0), u'(0 + 0) = u'(l - 0). 

Problem (5)-(6) has a unique solution having the estimate 

II u lie — II / Hc/?o 

in complete agreement with the maximum principle. 

For q 0 = 0 the statement of the problem is 

u" = -fix), u( 0 + 0) =; u( 1 - 0), u'(0 + 0) = u\ 1 - 0), 

which is solvable under the condition f(x)dx = 0 and possesses a unique 
solution u = u(x) only if 

(8) / u(x) clx = 0 . 

0 

Indeed, the general solution to the equation u n = —/(a;) admits the form 


i{x) = C\ x -f C 2 — J i J f(a) da I dt — C\x + C 7 - J (x - t)f(t ) 

n \ n ' n 


dt 


with arbitrary constants C 1 and C ’ 2 . 
With this, conditions (7) provide 


l 

J lit) dt = 0, 
0 ' 


Cj = — y t f{t) dt = 0 , 

0 


it being understood that the function u(x) can be recovered from condi¬ 
tions (7) within a constant C\. Under condition (8) we find that C 0 = 0, 
extracting a unique solution of the problem. 

As a first step towards the solution of the original problem, we initiate 
the design of a difference scheme on an equidistant grid Co h = )x i = ih, i = 
0,1,... , N) on the segment 0 < x < 1 with step h = 1 /N and approximate 
equation (5) and the continuity conditions (7). The first of these conditions 
is satisfied if y 0 = y N . 
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At the nodes x i — ih, i = 1,2,.. . , N — 1 , we write down the three- 
point equation 

Vxx ~ ?o V = -p(. x )> x = ih, i = 0,1,. .. , N — l . 

In this context, the difference derivatives 

u s,n — u '{ 1 - 0 ) - | h u"( 1 - 0 ) + 0(h 2 ), 

u x o = «'(0 + 0 ) + \ h u "{0 + 0 ) + 0 (/i 2 ) 

will be given special investigation. Substituting here u" — q 0 u 0 — / recov¬ 
ered from (5) we obtain 

u x,N + 2 u (l) — /(l ~ 0)) = u ' (1 — 0) + 0{h 2 ), 
u x,o ~ 2 ^(?o M ( 0 ) — /(0 + 0 )) = u (0 0 ) + 0(h 2 ), 

With these relations established, the second continuity condition u'(0 + 0) = 
u'(l — 0 ) is approximated to 0{h 2 ) by the difference equation 

(9) u x,o ~ ^(loVo + \ h f{0 + 0) = u SN + \hq 0 y N — 5 h /(I - 0 ) . 

By merely setting J/jv+i = ih condition (9) becomes 

u xx, n ~ 1o Vn — ~Pn> ‘Pn = 5 (/(l — 0) + /(0 + 0)) . 

This is a way of establishing the correspondence between problem (5), (7) 
and the difference scheme 

( 10 ) Vxx ~ 1o V = -P{ x ), x — ih, i= 1,2,... ,N, 
with the conditions of periodicity 

(11) ' 2/o = 2/tv> Vi = Vn+i ■ 

We will elaborate on this for rather complicated cases and turn to the 
equation with variable coefficients 

( 12 ) (kuj -qu= -f(x), 0 < x < 1 , 


where k(x), q(x) and f{x) refer to periodic functions of period 1: 
(13) k(x+L) = k(x), q(x+l)-q(x), f(x + l)=f{x), 
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which are continuous at the point x = 0 (x — 1), so that k(l — 0) = 
k {0 + 0) = At( 0), etc. Let 

(14) k{x) > Cj > 0 , q(x) > Cj > 0 . 

Assuming this to be the case, it is required to find a solution to equation 
(12) subject to the periodicity condition u(a: + l) = u{x), which is equivalent 
to the requirements 

(15) w(0 + 0) = u(l-0), ku'\ x=0+0 = ku'\ x = 1 ^ 0 . 

The maximum principle implies that problem (12)—(15) is uniquely solvable. 
With this in mind, we start from the scheme for 0 < x — ih < 1: 

( a yg) x ~ d V = -<P{ X ) . x = ih, i = l,2,... ,N -1, 

keeping y 0 = y N . The coefficients a, d, ip can be recovered from the condi¬ 
tions of second-order approximation in Section 2.4. 

With the aid of the equalities 

( a yg)i = ( k u ')i -o + \ h (/ - qu)i_ i + 0(h 2 ), 
a i+ 1 u x ,i = u ')i+ o - \ h (/ - qu)i +0 + 0(h 2 ) 

the condition ku'\ x=Q+Q = ku'\ x = l _ Q is approximated to second order by 
the difference relation 

«i Vx ,o “ 5 h(q(0)y o - /(0 + 0)) = a N y x N + \h(q{ 1 - 0) y N - /(I - 0)) . 

Under the agreements y N+ j = iq and a jv+1 = a 1 the preceding reduces to 

(ayg) x ~ dy =-ip(x) , x = x N = l, 


with 

d = d N = 4 (g(0 + 0) + q( 1 — 0)), p> = | (/(0 + 0) + /(I — 0)) , 

leaving us with the periodic difference scheme 


x = ih, i — 1,2,... , N , 


( 16 ) 


( a y x ) x - d y = > 

a > Cj > 0 


d > Cj > 0 
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subject to the conditions 

(17) y 0 = y N , y-i = Vn+i > a i = a N+ i • 

For determination of j/ 8 -, i = 1, 2,.. . At, we obtain the system of equations 

a i Vi- 1 - (a, + «;+! + ^ h 2 ) y { + a i+1 % +1 = -y* h 2 , i = 1 , 2 , ... , At , 

supplied by the conditions of periodicity. y 0 = yy and j//v+i = y l . This 
system can be solved by the cyclic elimination method (for more detail see 
Chapter 1, Section 1.2). 

Since a > c 1 >0 and d > c l > 0, the maximum principle is still valid 
for problem (16)—(17), due to which 


ll#llc< j-IMIc- 

L 1 

The inequality obtained permits us to derive for the error z = y — u the 
estimate 

\\z\\ c = 0(h 2 ), 

since ip i = 0(h 2 ) for * = 1,2,... , . Thus, scheme (16)—(17) is of second- 

order accuracy in the space C when k(x) £ C^ and q(x), f{x) £ C^K 

3. Monotone schemes for an equation of general form. The object of 
investigation is the boundary-value problem 


Lu = (k u'y + r(x) u — q{x) u = —f(x) , 0 < x < 1 , 

(18) 

u(0) = u j , u(l) = u 2 , k(x) > Cj > 0 , | r(x) \ < c 2 , q > 0 . 

The main idea here is connected with the design of a new difference scheme 
of second-order approximation for which the maximum principle would be 
in full force for any step h. The meaning of this property is that we should 
have (see Chapter 1, Section 1) 

(19) Ai y i _ 1 - Q tji + Bi y i+1 = -F t , i = 1,2,... , N - 1 , 

where A{ > 0, Bi > 0 and Ci — Ai — Bi = Di >0. 

Any such scheme is said to be monotone. As before, the operator 
Lu = ( ku 1 ) 1 — qu is approximated to second order by the homogeneous 
three-point scheme Ay = (aj/j.) — dy. 
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The natural replacement of the central difference derivative u'{x) by 
the first derivative a. leads to a scheme of second-order approximation. 
Such a scheme is monotone only for sufficiently small grid steps. More¬ 
over, the elimination method can be applied only for sufficiently small h 
under the restriction h \ r(x) | < 2 k(x). If u' is approximated by one-sided 
difference derivatives (the right one u x for r > 0 and the left one u s for 
r < 0), we obtain a monotone scheme for which the maximum principle is 
certainly true for any step h, but it is of first-order approximation. This is 
unacceptable for us. 

It is worth mentioning here that the sign of r(x) has had a significant 
impact on construction of monotone schemes. One way of providing a 
second-order approximation and taking care of this sign is connected with a 
monotone scheme with one-sided first difference derivatives for the equation 
with perturbed coefficients 

(20) Lu = —f, Lu = x^ku'y -f r u — qu , 

where x = 1 /(1 -( -R) and R = 0.5 h \ r \/k is the Reynolds difference number. 
By obvious rearranging r(.-r) as a sum 

r = r + + r~ , r + = | (r + | r |) > 0, r~ = f (?• - | r |) < 0 , 

the expression ru! is approximated by the formula 

(' ru ')i = i ku ')) i ~ b t a i +1 u x,i + K a i u s,i - 

where = F [r ± (x i -|-s/i)], r± = r^/k, F is a pattern functional being used 
for calculations of the coefficients d and tp. We may accept, for instance, 
b+ = r + 1 anc | b~ = r ~ jk. As a result we get the homogeneous scheme 

Ay = x(ay x ) x + b+a^^y^. + b~ay s - dy = -tp , 

(21) y 0 = u 1 y N — u 2 , a^ +1 ^ = a(x + h), a > q > 0, 

x R - HA 

— l+i?’ 2k ' 

We are going to show that scheme (21) is monotone by observing that 

(22) Ai i 4 _ j -CiViA B { y i+1 = tp { , y 0 = u 1 , y N = u 2 , 
where 

A = ^ (*i ~ h 67), Bt = ( x . + h 6 +), Cl = Ai + B l+ d { . 
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As can readily be observed from the foregoing, Ai > 0, Bi > 0 and D{ > 0, 
since b~ < 0, bf > 0 and d 4 > 0. 

Equations (22) can be solved by the elimination method for any h and 
r. The error of approximation for scheme (21) 

tj) = x (auj) + 6 + a^ +1 - ) u a , -f b~ au s — du + ip — (Lu -f /) 

is representable by -ip = + 'ip 1 '- 2 ) with the members 

^ (1) = \{ au s) x ~ du + <p\ - [( ku')' - qu + f] , 

i// 2 -* = [(x - 1) (o%) ^ + b + a( +1 ' > u x + b~au x ] — r u! . 

The first summand satisfies the estimate 

= 0(/i 2 ) for k g C {3 \q,f e C (2) . 

By virtue of the relations 

b+ = f+ + 0(h 2 ), b~ = r~ + 0(h 2 ), 

kr ± = r ± , r + + r~=r, r + -r~ = \r\, 

au x = ku 1 — | h(ku')' + 0(h 2 ), 

= jfeu'+ | ^(Atm')' + 0(/t 2 ), 

( au x) x = ( ku 'y + o(h 2 ) 

we obtain 

6 + a^ +1 - , u a; + b~au e = ru' + -h(ku') 1 -LJ- -f 0(h 2 ), 

^(2) = (fcu /y + + 0(/l 2) = (* u 'y + 0{ h 2) = 0(^2) 

ix -(- 1 ix H - 1 

exploiting the fact that R = 0.5 h \ r \/k = O(h). 

Because of this, the monotone scheme (21) generates an approximation 
of order 2; 


( 23 ) 


= 0(h 2 ). 
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If g > Cj >0, then for a solution of the difference problem (21) the maxi¬ 
mum principle provides the estimate ||j/|| c < Jj-||y|| c w ith y 0 = Vn = 0, 
which implies on the basis of (23) the uniform convergence of scheme (21) 
with the rate 0(/i 2 ). 

The monotone function (21) is quite applicable when r(x) is a fastly 
varying function of the variable x and the condition R < 1 fails to hold at 
some points with no influence on the accuracy to a considerable extent. 

The same procedure with a monotone scheme works on a non-equidis- 
tant grid. 

One more method available for designing a monotone scheme is related 
to equation (18). In preparation for this, let us multiply equation (18) by 
the function n(x) and require that 

H (k u')' + r n v! — (k /i u 1 )' . 

This is true only if r/i = k/i', so that 


v{ x ) = Vo ex P 


/ r(t) dt 

o 


r = 


r 

k 


The equation 

(fi k u'Y — fiqu = — /i / 

can be approximated by the conservative monotone scheme 

(24) (fiay s ) x ~ V d y - ~H<p, = n{x-\h), 

where, for instance, the members are taken to be a i = k i _ 1 ^, d i = q i} 

The number n(x) may be very large when the ratio f = r/k grows. 
Dividing both sides of the difference equation 


( 24 ') /(2 K+i^+i'/2(%+i - Vi) ~ RVi-i/iiVi - Vi- 1)] - Vi 1i Vi = ~Vi fi 

by fi i = fi 0 exp | r(t) dt j-, we obtain the nonconservative, but monotone 
scheme 


1 /T 


(25) 


l ipi Vx, i Vx, i) QiVi fi ’ ^ 1, 2, . . . , iV 1 


y 0 = U 1 > Vn = U 2 : 
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with the coefficients 


(25') 



ft is straightforward to verify that the scheme concerned provides an ap¬ 
proximation of order 2 due to the expansions 


= k ' + r . + 0 (h*), b -<±* = k l + 0(/i 2 ) . 

Replacing the integrals in (25') to 0(h 2 ) by the expressions | (3f ; + r i+1 ) 
and | (3fj- -f- respectively, we arrive at the monotone scheme with the 

coefficients 


b i - «*+! exp ( | (3rq + 


' ! + l 


and 


a i ex P \ ~ s ( 3? 5 + 


generating an approximation of order 2. 

4. Difference schemes for a stationary equation in cylindrical coordinates. 

The stationary diffusion or heat conduction equation 

div (k grad u) — qu — — f(r, ip, z ) 
takes in the cylindrical coordinate system (r, ip, z) the form 


(26) 


- (rk(r) —— q(r) u = —f(r), 0 < r < R, 

r dr V dr J 

q(r) >0, 0 < Cj < k(r) < c 2 , 


in the case when the solution u — u(r) depends neither on 2 nor on ip, that 
is, in the case of the axial symmetry. 

When r = 0 we impose the boundedness condition | u(0) | < 00 being 
equivalent to the requirements 


lim r k(r) — = 0. 
r—> 0 dr 


( 27 ) 
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When r = R one of the usual boundary conditions applies here, for instance, 

(28) u(R) = fi 2 . 

Let Uj(?’) and u 7 (r) be linearly independent solutions to equation (26), 
Uj(r) being bounded for r £ [0,i?]. A brief survey of their properties is 
presented below. 

1) If 5(0) and /(0) are finite, then 'Uj(O) ^ 0 and ^((0) = 0. 

2) If q(r), /(r) £ C^ 2 ^[0,i?] and k(r) £ C^^O, R], then the derivatives 
u', u”, u j 3 ’ 1 and are bounded for 0 < r < R. 

3) The second solution u 2 (r) of equation (26), which is linearly inde¬ 
pendent of Uj(r), has a logarithmic singularity at the point r = 0. 

Conditions (27) and (28) together provide the existence of a unique 
solution to equation (26). By virtue of property 1) condition (27) can be 
replaced by 

(29) u'(0) = 0. 


We proceed as usual and introduce on the segment 0 < r < R the equidis¬ 
tant grid u> h ~ {r i = ih, i — 0,1,... , N, hN = R}. 

Still using the framework of Section 2, a difference scheme for equation 
(26) can be obtained by the balance method: 


(30) 


W i + l/2 W i- 1/2 1 

r,- h r,-1 


'i + i/2 ! i + i/2 

J qur dr — -— J /(?’) r dr , 

r !-l/2 r i-l/2 


where 


r i — ih, i = 1, 2,... , N — 1 
C±i/2 = r i ± \ h > 


, R 

h =N-’ 


1 ( \ du 
w = r k(r) — 

dr 


Approximating the flow w by the expression 


~r ,._,/2 K ~ u t -i)/ h 

and substituting d i u i r { h and ip t r i h, respectively, for the integrals in the 
balance equation (30), we arrive at the difference equation 


(31) A y i - — (rq_ 1/2 cq y eii ) rJ - d, y { = 


1,2,... ,N- 1, 
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where 


Vf, 


Vi ~ Vi-i 


Vr,i 


Vi +1 - Vi 


the coefficients cq, d i and ip i are chosen so that 

(32) a i = k i _ 1 j 2 + 0(h 2 ), d { = q { + 0(h 2 ), Vi - /,- + 0(h 2 ) . 
In the simplest case we accept 

(33) a i =k i „ 1/2 , di = qi, <Pi = fi ■ 


Let us approximate the boundary condition at ?’ = 0 that can be 
declared to be the condition of the zero flow at r — 0: w(0) = 0. We are 
going to show that the difference boundary condition 


(34) 


«1 2/r(°) = \ (?(%(°) - /(°)) 


has the approximation error 0(/i 2 ) on a solution to equation (26) satisfying 
the boundary condition (27). 

Indeed, the residual for (34) is equal to 

(35) v = cij w r (0) - ^ (<?(0) y(0) - /(0)) . 

The forthcoming substitutions 

a, = k 0 + lhk' o + 0(h 2 ), u r (0) = u'(0) + ± h"u(0) + 0(h 2 ) 

yield 

(36) v - (ku )o + ~ h ( ku')' Q - ^ (q 0 u 0 - f 0 ) + 0{h 2 ). 


From equation (26) we deduce that 


(kit 1 )' = qu - f - 


k u' 
r 


Since u' —> 0 as r —> 0, we have 


ku' 

r 


(ku'y 0 


as r — > 0 
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and 

(37) (k u ')o = (qu- f) 0 - (k u')' Q = ^(qu- f) 0 . 

Substituting (37) into formula (36) and taking into account (29), we get 
v — 0(h 2 ). 

The difference boundary condition (34) can be expressed by 


1o Vo ~ fo 


With these, the difference scheme 


(38) 


A y = - ((?• - \ h)ay f ) r - dy = -<p 


0 < r = ih < 1 , 


a i Vr ,0 

K 


- %y 0 = -f 0 > 


h 

^ > Vn — > 


is put in correspondence with problem (26)—(28). 

The statement of the difference boundary-value problem for determi¬ 
nation of y i is 


A %•_! - Ci % + A i+ 1 y i+1 = -Fi, i = 1 , 2 ,.. <N - 1 , 

(39) ra . 

A; = r4 i C 1 , = Ai + Aj +1 + r i d i , Fi = ip i r,-, 
h 2 

which are supplemented with the boundary conditions 

(40) - j/ 0 = *h ?/i + > Vn = . 

where 

H i — a i j ( a i d 7o) an< 4 AC — fo j ( a i d • 

This problem can be solved by the elimination method (see Chapter 1, 
Section 1), for which the stability conditions are satisfied, because Ai > 0, 
Ci > Ai + A+i and 0 < Xj < 1, x 2 = 0. 
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We now estimate the accuracy of scheme (38). Substituting into (38) 
y — z + u, where u is a solution of problem (26)-(27) and y is a solution of 
problem (38), we may set up the problem for the error z = y — u: 


Az = - ((r — \h)a z f ) — dz = —ip , 0 < r = ih < 1 , 


(41) 


0 


- q 0 z 0 = -v, z N = 0 , 


where ip and v are the errors of approximation to the equation 


(42) 


1 


i>i = — ( r ;-i/2 a-i u f>i ) r , ~d iUi + 


and the boundary condition 


(43) 


L \ a r ,0 


- % U 0 + fo 


respectively. 

The balance equation (30) with regard to ip gives 

'<Pi = “ Vr,i + i>*i > di = r i- 1/2 (a, «f, * - ( k , 


r i + 1/2 


r * + 1/2 


i>* = Vi- 


f(r) r dr — d { u • - 


qur dr . 


r i- 1/2 


Next, we set r = r 4 - -+- s/i and develop the expansion of integrals involved in 
the formula for ip* in powers of h: 


1 

h r. 


r i + l/2 1/2 

- / /(r) r dr = — f /(rq + s/i) (r,- + sh) 

%J d 

r i—l 12 “ 1/2 


d.s 


1/2 1/2 
J f(r i + s/i) ds + — J (/ ; + sh/' + 0(/i 2 )) s ds 


- 1/2 


4 + °( /j2 ) 


- 1/2 
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By the same token, 

r i + 1/2 

1 f h 2 

j~~~ / qur dr = q t u { + (q u)' + 0(h 2 ) , 

r i~ 1/2 

so that 

(44) r t = (? u - f)i + 0 (b 2 ) > 

giving || r ip* || c = 0(h 2 ). 

0 

It is clear that the function T) i = a i u f i — (ku')i^ 1 / 2 = 0(h 2 ), meaning 

(45) \ = 0(h 2 ). 

Comparison of formulae (35) and (43) yields v = h*v. This provides sup¬ 
port for the view that v = 0(h), because v — 0(h 2 ) as stated above. 

In order to estimate the error z = y — u, we shall need an auxiliary 
lemma. 


Lemma Let z be a solution of problem (41) and let v be a solution of the 
same problem for d i = 0, i = 1, 2,... , N — 1, q 0 = 0. Then the inequality 
is valid: 

(46) II ar || = max |z-|<2||v|L. 

To prove this assertion, it suffices to use only the lemma of Chapter 1, 
Section 1, Subsection 8 and to write down the equations for z and z — v in 
the form (41). 

The function v i can be recovered in explicit form from the conditions 


w i +1 - w i 


=-¥> * = 1,2,... , Af - 1, w i = v. 


r,2 > ^i ^2 C —1/2 > 


V N — 0 , 


h * C 


h 2 

— v, that is, w 1 = — —v, 


n 


where i/q is specified by formula (42) for d i = 0. Summing the equations 
w k+i = w k ~ hr k 'Pk over k = 1 , 2 ,... ,j yields 


3 

Wj + i - », - hV k 
k — 1 




if_ 

¥ 


V . 


(47) 
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Substitution of Wj +1 = bj +1 ( v j+i — v j)/h into (47) leads to the relation 


w, h h 


w, n u i 

r- + r- T, h <■>*>■ 


v i = «j+i - — + — 

°3 +1 °j +1 *_! 


Recalling that i>jy = 0 and summing equalities (48) over j = i, i+1, . . . , N- 
1, we obtain 


N— i , JV-i , i 

I] — +1] —J2 hr ^k- 

j=i t + r jj + i 


Substituting tp k = — rj rk + ■tp* k into (49) yields 


1 1 1 

7- I Z hr k Vd- = 7- (Vj+i ~ + 7- I] * ^ . 

°J+ 1 t = l d +1 J+ 1 t = l 


r 1 - t < Z-(l V. I + I V, I) + 7 


b j+i £[ “i+i 


“j+l r 3+ 1/2 


< “(I Z+ll+l l) + “ll^*llc 


in light of the relations 


7j+i — f j+l/2 Z'+l/2’ 


E /( = ' 7 Z 


Furthermore, we might have 


w 1 h 2 v < h~ I H ft I I 

ftj + l ^ r j+l/2 fl j+l ^ r i/2 C 1 ^ Cj 


As a final result we get the inequality 


(50) \\ v \\ c <X±M + i. £ h(\ 7 i+ i 1+ I I) + “IM* 

1 1 »=o 1 
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By inserting in (50) the estimates 

v — 0(h), K| = 0(h 2 ), \\rr\\ c = 0(h 2 ) 

we conclude that || v || c = 0(h 2 ) and, hence, 

IMIc < 2 II^lie < Mh2 ■ 

This means that scheme (38) is of second-order accuracy in the space C. 

Let us turn to a scheme of the second type known as a “scheme on 
the current grid”. We split up the segment [0,f?] into N parts by the nodes 
(current points) 


r 0 = 0, D = ±/q f 2 = f/i, ..., r i =(i-±)h, 

r N -i = (N-^)h, r N =(N-±)h = R. 


Denote by y i = y(r i ) the values of a grid function at those nodes. 

The balance equation for (26), which is an analog of (30), is aimed at 
designing the difference scheme, making it possible to write on the interval 
r i _ l = r i _ 1 j 0 < r < r i+1 / 2 = r i the difference scheme 


(51) —{r i _ l a i _ 1 y f>i ) r .-d i y i -\-if(f i ) = 0, * = 2, 3,... , TV — 1. 


where q — ih, r 8 - = (* — |)/h and a, d, tp are chosen by analogy with 
(32)—(33), so that in the simplest case 


(52) a { = k( ri ), = /(rq), d { = g(f ; ). 


The balance equation written on the interval 0 < r < r 1 = h 


• h 

W \ J ( f(r ) - q(r) u(r)) r dr = 0, w(r) 

1 1 o 

and the condition w 0 = 0 imply the difference equation 


k(r) u'(r ), 


(53) 


r 1 eq y rl 
fj h 


d i Vi + <Pi = o 


for r = r 1 = | h, where eq, d lt ip 1 are specified by formulae (52). 
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The standard condition 


(54) y N = y 2 

is imposed for r = R. As a final result we get the difference equation (51) 
subject to the boundary conditions (53) and (54). 

Let y = y(r) be a solution of this problem. We begin by placing the 
following problem for the error z — y — u: 

p ( r i-i a i -1 z f,i) ril ~ d i + V’(C) ~ 0 , 

'i 

(55) = * = 2,3,... ,7V - 1, z N - 0 , 

r , a, z , 

——-- d 1 z 1 +4> 1 = 0 , 

r 1 h 

where ip is the approximation error equal to 

= V’fc) = y (r i _ 1 -djUi + ipi, i = 2, 3,. . . , TV - 1 , 


'01 " - T a i u r t l U 1 + (p 2 

r : n 

with 

w* = u (c) = 1/2 • 

Combination of the resulting expressions and the balance equation on the 
interval r 1 __ 1 < r < r i gives 

' 2 

V; = a i __ 1 - k i __ 1 , 7 = 2,3,... ,7V, y 2 = 0 , 

r i 

0 . 0 1 f , 

q = <Pi -fi- (di - di) Ui + —j; r ?( r ) ( u ( r ) - m (0) dr = o> 


where 


0 





r 2-l 


r/(r) dr, 


di — 



r i-i 


r q(r) dr . 
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It follows from the foregoing that 




Vi 


Vi = 0(h 2 ). 


An estimate similar to that established for problem (41) is valid for a solu¬ 
tion of problem (55) with the right-hand side 



f-i ?? ») r + Vl — 


Vi 


yielding 

\\ z \\ c zz \\y- u \\c = °( h2 ')- 

This means that scheme (51), (53), (54) is of second-order accuracy if we 
agree to consider k(x), q{x) ) f(x) £ 1], 

5. Difference schemes for an equation in spherical coordinates. If a solution 
to the equation 

div (hgrad u) — qu — —f(r, 9, ip) 


in the spherical coordinate system is centrally symmetric, that is, is inde¬ 
pendent of 9 and p ) then the function u — w(r) satisfies the equation 


(56) 


1 d / . d«\ 

)2*:( r J-g(r)u = -/(r), 0 < r < R , 

0 < Cj < k(r) < c 2 , q(r) > 0 . 


In the general setting the function u(r) is supposed to be bounded at the 
point r = 0. This property is equivalent to the condition 


(57) 



= 0 . 

r = 0 


At. the point r = R we may impose, for instance, the standard condition 


(58) u(R) = n 2 . 

A bounded solution of problem (56)—(58) possesses the same prop¬ 
erties as in the case of the axial symmetry (for more detail see problem 
(26)—(28)). 
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We introduce on the segment 0 < r < R the equidistant grid ui h = 
{r t = ih, i — 0, 1,, TV, hN = R} and by analogy with (31) may attempt 
the scheme in the form 


( 59 ) A V; = m ( r i-i/2 a i Vr,i) 


; Vi = ~Vi 


i = 1,2, 


,7V - 1 


At the point r = 0 we impose the difference boundary condition 


(60) 


y r , o 

K 


?o Vo — fo ! 


h 

6 


and for * = TV set 


(61) y N = H 2 ■ 

These equations admit the form (39) and can be solved by the elimination 
method. The main difference from the cylindrical case lies in the selection 
rules for p and d. To obtain the formulae for p and d , we consider the 
residual 

(62) 4>i = A Ui + Pi = ~ (r 2 __ 1/2 a { u^)^. - d { u { + p { 

' i 

and subtract from equality (62) the balance equation written on the segment 
r i-i/2 < r < r i+ 1/2 


r i + 1/2 r i + 1/2 

„ W i + 1/2 — W i~ 1/2 1 f 2 7 , 1 f 

0= - Vr 5- —1 / quT dr+ h e / 


f r 2 dr, 


w = r 2 ku'. 


The outcome of this is 


r i- 1/2 


1/2 


i’i = ^2 ? ?»V + V 1 * , Vi = r i- 1/2 Vi* a i u f,i ~ ( k U Vl/2 > 


where 


?, ! + l/2 / r * + l/2 ^ 

(63) i>* = ^ I f r 2 dr - j d { u i ~ f qur 2 dr 


T i~ 1/2 


r i ~ i / 2 
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After replacing the variable by r — jq + sh we find that 

r » + l /2 1/2 

J^2 j f r2dr =^2 J fi^+s^iri+sh ) 2 ds 

1 n-i !2 *- 1/2 

1/2 1/2 1/2 
= j f{vi + sh) ds + ~~ j s /(jq + sh) ds + ^ j f(r { + sh) s 2 ds 


- fi + 0(h 2 ) + — f' + fi + 0(h 2 ) 


- { 1 + i2^j fi + 67 t f ' +0{h2) - 

Also, a similar expression can be derived for the second integral by merely 
setting qu in place of /. From here and formula (63) it is plain to show 
that 

= f r ~ (?« - f)'i + 0(h 2 ) , || r i/* || c = 0(h 2 ) 

if ip { and d t are specified by the formulae 

( 64 ) = ( 1 + 10^2) ’ di ~ ( X + T^) 9i ’ * = 11 2> ■ ■' ,7V “ 1 ’ 

i i 

or by other formulae differing from (64) only by the quantity 0(h 2 ). 

Arguing as in the preceding section, we verify that the residual in the 
boundary condition reduces to 

Cl-i U,. pi 

(65) 12 = — ~ - % u 0 + fo = 0(h). 

To develop those ideas, we contrived to do it with further reference to the 
problem for the error z = y — u 


A z = —tp, r £ Lo h 


~ % u o = - ;y > z n = 0 • 


A solution of this problem can be estimated in a similar way as was done 
in the preceding section, but with b i = In concluding this sec¬ 

tion we establish through such an analysis that scheme (59)—(61) converges 
uniformly at the rate 0(h 2 ): 

Ik lie = Ik- u llc = 
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3.6 DIFFERENCE GREEN’S FUNCTION 

1. Difference Green’s function. Further estimation of a solution of the 
boundary-value problem for a second-order difference equation will involve 
its representation in terms of Green’s function. The boundary-value prob¬ 
lem for the differential equation 

0 < x < 1 , 
q(x) > 0 , 

can add interest and aid in understanding. As known, the solution of this 
problem arranges itself as an integral 

(2) u(x) = / G(x, £)/(£) d L 

o 

where G(T,£) is the source function or Green’s function. Function (2) is a 
solution to equation (1) subject to the boundary conditions w(0) = 0 and 
w(l) = 0 if Green’s function G(T,£) as a function of x for fixed £ satisfies 
the conditions 


(1) 


LU= dx ( kU = 


it(0) = 0, 


t(l) = 0, k(x) > Cj > 0, 


( 3 ) 


L x G{x,0 = ~ ( k(x ) ~ ( l( x ) G ( x ’0 = °> 

x yf £, 0 < 2 : < 1, G(0, £) = G(l, £) = 0, 


[G] = G(£ + 0,£)-G(£-0,£) = 0, 





for 


_ e 
— S 


The very definition implies that Green’s function is nonnegative and 
symmetric: 

G(x,£)>0, G(x,£) = G(£,x). 

The function G(T,£) so defined can be written in the explicit form 


( a{ x)P{Q 

a{\) 


for x < £ , 


(*{£,) P( x ) 

a(l) 


for x > £ , 


( 4 ) 


G(x,£)= < 
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where a(x) and /3(x) are solutions of the relevant Cauchy problems: 

La = 0, 0 < x < 1, a(0) = 0, k(0) a'(0) = 1, 

( 5 ) 

L/3 — 0, 0 < x < 1, f3{\) = 0, k( 1)/?'(1) = -1. 

The functions a(x) and /3(x) are linearly independent. This is due to 
the fact that the Wronskian is nonzero A(x) yf 0. Moreover, a(x) > 0 for 
x > 0 and j3(x) > 0 for 0 < x < 1. 

We now turn to a difference equation of second order. We learn from 
Chapter 1, Section 1 that any difference equation of second order T; y i _ 1 — 
CiUi + BiVi +1 = — Fi can be treated as an equation of divergent type, 
meaning 

a i+i (Vi+1 ~ Vi) ~ a i (Vi ~ Vi-1) ~ d i Vi = ~Vi ■ 

By replacing here Lp i by h?{p i and cl { by /i 2 ^- we obtain 

A Vi = h+i (Vi +1 - Vi) ~ a i (Vi ~ Vi-i)} - d l y l = ~Vi , 
i = 1,2,... ,7V- 1, 

which is more convenient for the further comparision with the differential 
equation. For the moment, we write down this equation without subscripts 


( 6 ) 


A V = (« Vx) x - dy = ~v( x ) . X = ih, 
a (x) > Cj > 0 , d(x) >0, i =1,2,... ,7V— 1 . 


For i = 0 (x = 0) and * = TV (x = 1) the boundary conditions of the 
first kind are imposed as usual: 


(7) y 0 = 0, y N = 0. 

Common practice in numerical analysis involves the inner products 
N — l N 

(y, v )~ E Vi v i h y (y,v\ = J2vi v i h - 

2—1 2—1 

The traditional way of covering this is to seek a solution of problem (6) in 
the form 


N-l 

Vi= E GikVk h = (G ik ,<p k ) 


kzz 1 


( 8 ) 



Difference Green’s function 


201 


under the agreement that this expression solves the equation A y i = — ip i . 
From the equality Aj/, : = Ylk=i \i) Gik <Pk h it i s easily seen that equation 
(6) holds true only if A^ Gik = — 8 ik /h, where 8 ik is Kronecker’s delta: 


8 


ik 


1, i — k , 
0, i yf k . 


The equalities y 0 = y N = 0 are certainly true for the choice Gok = GW* = 0, 
thus formula (8) gives the solution of problem (6)-(7) if G,k = G(x { ,x k ) 
as a function of i for fixed k = 1,2,. .. , N — 1 satisfies the conditions 


( 9 ) 


A(i) G{ k — ( a i ( Gik)x,i) x i — d { Gik — 
i,k — 1,2,... , TV — 1 , G ok = G Nk = 0. 


We must show that Green’s function specified in such a way exists and 
find its explicit representation similar to expression (4). With this aim, the 
functions a i and /?, will be declared to be solutions of the corresponding 
Cauchy problems 


A Of ; = 0 , i = 1,2,...,N — 1, 


( 10 ) 


a 0 = 0 


= 1 . 


A ^ = 0 
Pn — o i 


*= 1,2,... ,7V- 1, 

o _ Pn - Pn — 1 _ 

a N Px,N — a N 7 - 


It is straightforward to verify that the functions ay and /?, possess the 
following properties: 

1) oq and Pi are positive functions, a i being monotonically increasing 
and Pi being monotonically decreasing: 


< a*+i < a N , P, < Pi < P 0 , 

ay > 0 for i — 1,2,... ,1 V and P t > 0 for i = 0,1,N — 1. Indeed, 
conditions (10) imply that 

i~i h 

G a si - 1 + E h d k a k , Q i = > 0 . 

k = 1 a i 
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If aq > 0 for k = 1,2... , z — 1, then a, a s ,■ > 0 and a t > a i _ 1 > 0. 
In a similar way we can be pretty sure that /3 S i < 0 and 0 < A < A-i- 

2) a N ~ f3 0 or a(l) = /?(0). From the second Green formula 

(a, A /?) = (/?, A a) + a w (a/? £ - /? - a 2 (a/? x . - /? a x ) Q 

it follows immediately that a N = j3 0 on account of conditions (10). 

3) The determinant A,■ = a { (a s t A — oqAri) = const = a N is pos¬ 
itive for 0 < i < TV. Applying the second Green’s formula in the domain 
{0 < x { = ih < Xi a = a;} we obtain 

i 0 ~l 

0=E ( aA P~ P Aa )i h = Go { a Px ~ P a x) io ~ a i (a fix ~ P®x) 0 

1 = 1 

= - a (g 0 ) + P(°) a i a x,i = - a (g 0 ) + A> • 

Since x io = x is an arbitrary node of the grid io h , we might have 
A(x) = const = /?(0) = a(l). 


Other ideas are connected with a possibility of arranging the Green 
function such as 


( 11 ) 


G ik = { 


a i Pk 

for 

i < k , 

a N 



»kP t 

for 

i > k . 


X N 


Whence it follows that Gok = GVfc = 0. 

The preceding representation will be proved if we succeed in showing 
that the function specified by formulae (11) solves the equation A (j,)Gik = 
— 8 ik /h, Indeed, A (i)Gik = 0 for i ^ k due to the facts that Aoy = 0 and 
A (3 i — 0. The expression A^Gik for i = k needs investigation: 


(12) ( A (i)Gik)i = k — , 2 \ a k + l ( a k Pk + 1 a k Pk) 

CXjsf ft 

~ a k ( a k Pk — a k~l Pk)} ~ d k Gkk ■ 


From the condition Aj, +1 = a k+1 (a k+1 f3 k — a k (3 k+l )/h — a N we 
derive the expression a k+1 a k f3 k+1 = a k+1 a k+1 (3 k — ha N and substitute it 
into the right-hand side of formula (12). As a final result we get 


( A (t) Gik)i~k 


Pk 

a N 


(““*)*,* 


1 

h 


d k Pk 
a N 


®k 


Pk 

a N 


Aa k 


1 

h 


1 

h 
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as required. 

Formula (11) means that Gik > 0 for i,k yl 0,7V and Git = Gki- 
Moreover, Git as a function of k for fixed i satisfies the conditions 


a r' — E 1 

A(fc) Gjjt -r- 


h 


Gin — GiN — 0 


In the case of the boundary conditions y 0 = x l y 1 and y N = x 2 y^-i 
the Green function can be constructed in a similar way. Of interest is the 

0 ® 

special case where d(x) = 0. Here the functions a = a(x) and /? = (3(x) 
can be determined from equations (10) in the explicit form: 

i 1 „ N L 

« 13 » '■=££ 

and the Green function related to the problem 

( 14 ) ( a y$) x = -V’ 

reduces to 


(15) 


Gik — \ 


s = 1 

k 


X £ u h , 

o' 

II 

o 

Vn = 

N 7 



v ^ h 

/t.t- 

-4fi 

VI 

5=& + l S / 

5 = 1 5 


N 



^ E / 

/e-’ 

i > k , 

s = i + l 5 / 

5 = 1 5 



For the best scheme (15), (17) arising in Section 2 Gik coincides on 
the grid u) h with Green’s function for a differential equation. 


2. A priori estimates. The explicit representation (8) of a. solution of 
problem (6)-(7) in terms of Green’s function lies in the background of 
various a priori estimates of a solution in terms of the right-hand side. It 
is easily seen from (8) that 

N-l 

(16) \Vi | < (G ik , \<Pk I) = E G ik \ipk\h 

k = 1 

and, therefore, a uniform estimate of y i can be obtained by estimating 
max^jfc Gik • In this line, arranges itself as 

(17) V-Vx, ^i = 0, Vi=J2 hl fis, i= 2,3,... ,7V. 

S = 1 

Upon substituting these expressions into formula (8) we deduce by the 
summation by parts formula that 

(18) y(x) = (G(x,0, V() = -(<++,0, V(Q] , x,(€ u> h . 

The next step is connected with | G'^(x,^)|. 
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Lemma For the Green function G(x,£) related to problem (6)-(7) the 
uniform estimates 


G(x,£) < — 

c 

C 1 


Gx(x,0 1 <—, — 


are valid for all x, £ £u, r 

Proof 1) In Chapter 1, Section 1 we have obtained for a solution of problem 
(6)-(7) the estimate 

N~l 1 i 1 N -1 i 

pi) iisii c < E — Ei ft V.i< r E Ei^vj. 

i = 1 ! + 1 s~ 1 1 t' = l s = l 

Replacing in (21) y i by Gjk and <p s by 6 sk /h, we establish the relations 


G ik <- ^2 hS i k < 


1 — x,. 1 


where 


Sik = Y S sk > S ik = 0 for i < k, S ik = 1 for i > k. 

s = i 

2) Let d(x) = 0 and the Green function G = Go(x>0 be specified by 
formulae (15). Assuming this to be the case, we find that 


Gox (f > 0 


a x( x ) 


a (0 Pg(x) 


for x < £ , 


for x > £ . 


By virtue of the relations 


a,- c, a,' c. 
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we arrive at 

(22) G os (x,0 < - . 

C 1 

By the same token, 

<-■ 

C 1 

Let v(x,£) = G o(x,£) — G(x,£). The equations for Go and G imply 

that 

A a v(x,£) - -d(x)G 0 (x,£), v(0,£,) = v(l,= 0. 

We can calculate the left difference derivative of both sides of this equation 
with respect to £, whose use permits us to establish for w(x,£) = vp 

A x w(x,£) = (a(x)w s (x,0) 3 . ~ d(x)w(x,£) = -d(x) G 0 p(x, £), 

10(0,0 = 0, w(l,O = 0. 

By the lemma from Chapter 1, Section 1, 

(23) max | w(x,£) \ < max | G Q f(x,£) I < — . 

X X ? Cj 

Using estimates (22) and (23) behind, we derive from the obvious inequality 
I G e -0',0 | < | G 0 f(x, 0 | + | w(x ,0 | 
the desired estimate (20). 

Theorem For a solution of problem (6)-(7) the estimates are valid: 

N— 1 \ N- 1 IV — 1 

f, E ^ =7 E ^ T.h'p. 

s—i / 1 i—l s—i 

2 / * \ c) N ~ 1 * 

(25) \\y\\ c <- !. E^ = 7 E h E^ 

1 V »=i / 1 i=i »=i 

When <p(x) happens to be of the form ip = r) x + ip* , a solution of problem 
(6)“(7) satisfies the estimate 

(26) \\y\\c<~{(^\v\} + (h\b\}}, 

C 1 

where ^ ‘P’l f° r * = 2,3... , TV and p i = 0. 
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Proof Putting p = rj x and applying then formula (18), we deduce by the 
preceding lemma that 

(27) kk)l< (|G e -(*,0!,b(0l] < -(i,b(0lh 

c i 

The function rj(x) can be recovered from the condition i] x = ip within an 
arbitrary constant. A solution to the difference equation 

r] t+1 - rp = h ip { 

can be expressed either by 

N-l N -1 

Vi = tin h( Ps~~Yl h V* if Vn = 0 

Szzi s —i 

or by 

i i 

T] i+1 = T], + h(fi s = h(p s if r ll = 0 . 

S —1 S — 1 

Substitution of these formulae for ^ into the right-hand side of inequality 
(27) leads to estimates (24) and (25). 

To prove inequality (26), it suffices to set ip* = p x) so that ip = ( r]+p) x 
and to repeat the preceding arguments. 

Remark Formula (16) entails the estimate 

Cj Cj Cj 

in the norm || p || = \J ( p , <p). It is plain to show the obvious inequalities 

|| E hl Pk || < (i, M) < IMI < Ik lie ■ 

k = l 

With the aid of the estimate 

l|C,(*,Ellc<r 

C 1 

an a priori estimate in the space C for the difference derivative of a solution 
of the boundary-value problem (6)-(7) can be derived without difficulty. 
Indeed, the relations 

\Vx I = | (Gs(x, £),¥>(£)) I < — (Ckl) 

c i 

vs IP < -r (r kl) • 

c i 


lead to 
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3.7 HIGHER-ACCURACY SCHEMES 

1. An exact scheme. For equation (1) in Section 1 it is possible to make 
the design of a homogeneous conservative exact three-point scheme so that 
a solution y i of the difference problem is identical with the exact solution 
u — u{x) of problem (1) from Section 1 at all the nodes of any grid u) h : 

y i =u{x i ) for M,/£<2 (0) [0,1] • 

Before giving further motivations, it will be convenient to set up problem 
(1) arising in Section 1 in the form 


(!) «> u = ~ d £j ~ ?(*)« = “A*) > 0 < 1 < 1 > 

u(0) = u 1 , u(l) = u 2 , p{x) = k~ 1 (x), 0 < p(x) < — , q(x) > 0 . 

c i 

It is worth noting here that the best scheme (14)—(15) of Section 2 is exact 
for q = / = 0. Indeed, the function 

(2) u(x) = u 1 + c f p(t) dt , c = (w 2 — Mj) If p(t) dt j 
o v o ' 

is just the solution of problem (1) for q — f = 0. From such reasoning it 
seems clear that 


X, 


p{t) dt 


x i -1 


c 

— ’ 


where a i — yh 1 ff 1 p(t) dtj and, therefore, function (2) solves the 
equation (aw d ) x = 0. 

We now turn to equation (1) on an equidistant grid w h . A key idea in 
the further development of an exact scheme is to express at any inner point 
(and, particular, at x = aq) of the interval (x i __ 1 , x i+1 ) a solution w = u(x) 
to the second-order equation (1) in terms of the values u i _ 1 , u i+1 and the 
right-hand side f(x). This can be done using u(x) in the form 

u(x) = Ai v\ (x) + Bi v l 2 (x) + w((x) , x i __ 1 < x < x i+1 , 


( 3 ) 



208 


Homogeneous Difference Schemes 


where A{ and 5,; are some numbers which will be specified in the sequel, 
v*(x) and v l (x) are linearly independent solutions to the homogeneous 
equation L^ p,q hi = 0 (pattern functions) and v 3 (x) is a particular solution to 
the nonhomogeneous equation (1) subject to the homogeneous conditions: 

(4) L^'^vl = f(x), x^ < x < x i+1 , vl(x i+1 ) = vKx^,) = 0 . 

The accepted view is that the pattern functions aj(x) and v l 2 (x ) 
will be declared to be solutions of the appropriate Cauchy problems 

(5) L { - P ’ q) v\ = 0, < x < x i+i , 




P( x i- i) 


{v\)'{x l __ 1 ) = 1, 


( 6 ) 


L(P'«)t)* = 0, x i __ 1 < x < x i+1 , 


V 2^ X i + ^) — ^ : 


{vi)'{x l+1 ) = -1 


i+H p(x i+1 ) Vi+1 

By merely setting in (3) x = x i __ 1 and x = x i+1 we find that 


(?) 


Ai = 


ll ( x i + 1) 


Bi = 


v i( x i~ i) 


Pattern functions so defined possess a number of nice properties (com¬ 
pare with Section 6), so there is some reason to be concerned about this: 


1) v l (x) is positive and monotonically increasing for x i __ 1 < x < 
v l (x) is positive and monotonically decreasing for x i _ 1 < x < 


2) the equality is certainly true: 

( 8 ) v \i x i+i) = v l( x i~i) ; 

3) the relation occurs: 


'! +1 ! 
' i +u 


(9) 


v\{x i+l ) = v\( Xi ) + vl(xi) + v l 2 (xi) / v\ q(x) dx 


X ?. + l 

+^(xj) J v’ 2 q(x) dx 


4) the recurrence relation is valid: 

v H x i) = v\ + 1 ( x r + l)- 


( 10 ) 
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We will prove the indicated properties, 

1) Property 1) follows directly from problem statement (5)-(6). 

2) Taking into account (5) and (6), we have for L = jC p .«) 


L i +1 


0 = j (vi Lv\ - vl Lv\) dx = (v\ - (g)' -vl~ ( v\y 

' l 'i -1 


H+i 


3) Applying Green’s formula on the segment [x i _ 1 , x { \ yields 


0 = J = 


M-l 

1 


1 


=— { vi 2 )'{ x i) v \{ x i) -— ( v \y( x i) v i( x i~i) + v K x i~i) 

Pi Pi 

Upon substituting here the relations 

,T j 

^-( v \Y( x i) = 1 + J q(x)v\(x)dx, 


v i +1 


— { v \)'( x i) = -1 - / <l(x) v l 0 {x) dx 

Pi J 


we establish property 3). 

4) Having stipulated the conditions 

1 (Jv i+1 

L (p,9) v *+i — o ) Xi <x<x i+2 , p +1 (ah) = 0 1 


p dx 


= 1 


the function v 1 ^ 1 (x) does follow 


x i+i 

0= J (v i + 1 Lv i 2 -v i 2 Lv i + i ) dx 


= {^i +i l^y-<l« +i y 

= -v\ +1 (x l+1 ) + v l 2 ( Xi ). 


v i +1 
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The function v 3 (x) admits an alternative form 

x i +1 

(n) v l 3 (x) = J G(x,£)/(0 < x £ i x i~i ! x i+i\ 


where G{x ,£) is the Green function related to problem (4) (see (11) in 
Section 6): 


( 12 ) 


v:(Z)v l 2 (x 


G(x,Q= { 


v i( x i+i) 

v\(x)v^) 


x i-i <Z <x, 


X < t; < X 


i+1 


( v \( x i+ l) 

By placing successively expression (12) and x = x i in (11) we obtain 


(13) 


vUx { ) = . , 1 —r 

v \( X i+l) 


vKg) / v\(omdt 


x i +1 \ 

+ v \( x i) J ^( 0 /( 0 #) 


By virtue of relations (7), (9) and (13) we deduce from (3) that 


(14) 


1 / u i+1 - u 


l Lt, l 


v i( x i ) 


v i( x i) 


d i w* = -<Pi 


where 


t'l+i 


( 15 ) ^ 


d ,■ = 


Vi = 


hv\{ x i) 


1 

hv[( x i ) 


v\(0q(0 # + 


v[(om dt+ 


h v i( x i) 


hv i( x ,.) 




x i +1 


vKomdz. 
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We now introduce a local coordinate system at a point x = x, by merely 
setting x = x^ + sh, s = (x — x^/h, in which the segment , x i+1 ] carries 
into the segment (pattern) — 1 < s < 1 with the node x = x i corresponding 
to the point s = 0. Then we concentrate primarily on ^(x) = v^x^+sh) = 
ha l (s,h) and u*(x) = + sh) = hf3‘(s,h), -1 < s < 1, t>*(Xj) = ha t 

and, because of (10), ^'(Ti) = ha i+1 . Being the pattern functions, a l (s,h) 
and /3 ! (s,/i) are subject to the conditions 


, , d ( 1 da \ n , , 

(Hi) La =-\ — -j- hiis)a -0, -1<«<1, 
a(-l,/i) = 0, a'(-l,h) = p(-l ), 

L/3 = 0, — 1 < s < 1 , P(l,h)~0, /?'(1, h) = -p(l), 

where p(s) = p(x { + sh) and q(s) = q(x i + sh) depend only on the values 
q(s) and p(s) (p(x) and q(x)) on the segment — 1 < s < 1 (on the segment 
x i~i < x < x i+1 ). Omitting subscript i in formula (14) we obtain the 
homogeneous conservative scheme for y(x) = w(x), x g ui h : 

(17) (a" 1 y s ) x - dy = -ip , x g w h , y(0) = u, , y(l) = u 2 , 

where 


( 18 ) 


a(x) = a(0, h) = T [p(x + sh), q(x + sh)] 
o 

1 f 

d(x) = ——— / a(s, /i) g(x + sh) ds 
a(x) J 


i(x + h) 


/ 3(s , h) q(x + sh) ds . 


^(x) 


i(x) 


a(s, h) f(x + sh) ds 


57TS) / «*>'*>/(* + *'.)*. 

0 
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The coefficients d(x), <p(x) can be calculated by one and the same formula 
ip(x) = F[p(x + sh), q(x + sh); f(x + sh )] , 

d(x) — F [p(x + sh), q(x + sh); q(x + sh)] . 

Pattern functionals are defined in the class of piecewise continuous 
functions: 


T[p(s),g(s)] for p(s), q(s) <E Q (0) [-l, 0] and 

F[p(s),q(s); f(s)] for p(s), q(s), f(s) <E Q (0) [-l, 1] . 

It is easily seen from (17)—(18) that the exact scheme does not belong 
to the family of schemes (16)—(17) in Section 2, whose pattern functionals 
T[p(s)] and T[/(s)] depend solely on a single function. In the case of 
equation (1) with constant coefficients p(x) = p 0 = const and q(x) = q 0 = 
const the pattern functions a(s, h) and /?(s, h) can be determined explicitly: 


sh (x(l + s)h) sh(x(l -s)h) 

a(s,h) = p 0 ---, p(s, h) = p 0 ---, 

x n x h 

X = VPo % ■ 

At the same time the coefficients a(x) and d(x) become constant values 
, , sh (xh) . , 2 q n , xh 

“(*> = <••• -17JT ■ <i(l) = Th 1 "' 

2. Schemes of arbitrary order accuracy. There is no difficulty to construct 
a scheme of arbitrary order accuracy by means of appropriate expressions 
for coefficients of an exact scheme. 

We now know from (16) that a(s, h) and f3(s, h) are analytic functions 
of the parameter h 2 and, therefore, can be expanded in the series 

oo oo 

(19) a(s, h) — J2 a k (s)h 2k , /3(s,h)= Pk( s ) h2k > 

' k =0 k~Q 

where a fc (s) and /3 k (s) are calculated by the recurrence formulae 


' k( s ) 


P(^) / a k-i( x ) ?( A ) dX dt i k>0, a 0 (s) 


p{t) dt . 


P k (s) = / pit) ( f P k „ 1 {\)q{\) cfA^j dt, k > 0, P 0 (s) — / p(t) dt, 
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One trick we have encountered is to take only a finite number of the mem¬ 
bers in series (19): 

m m 

a (m) (s. h) = £ a t (s) h 2k , A) = £ PM h 2k , 

k =0 k =0 

making it possible to determine the coefficients S m \ S' m ) and ip( m ) by 
formulae (18), where the polynomials and /?( m ) stand for a and /?. As 
a final result we get a scheme of accuracy 0(h 2m+2 ) in the class of piecewise 
continuous functions k(x), q(x), f(x) G Q(°)[0,1], Any such scheme is called 
a truncated scheme of rank m. 

For m — 0 it refers to schemes of zero rank and accuracy 0(h 2 ) with 
regard to k, q, f G QS\ When providing current manipulations, the 
expressions for d and ip involved in this scheme 

o 

a (0) = | = j p(x + sh) ds , p = -j- , 

a -1 

<i (0) = d + (hdjx , = <p + (tup*)# , 

0 

''* = “/ whh) J 

-1 - 1/2 

0 s 

• e - = l j whh) J «*+“•)<« 

-1 - 1/2 

are different from those being used in the best scheme (14)—(15) of Section 2. 
Truncated schemes-provide a possibility to attain any order of accuracy for 
arbitrary piecewise continuous functions k(x), q(x) and f(x) and appear to 
be useful in many aspects. 

An exact scheme and truncated schemes can be designed on an arbi¬ 
trary non-equidistant grid w h by the same methods as we employed before. 

In practice the use of truncated schemes in the case of equation (1) 
with variable coefficients necessitates carrying out calculations of multiple 
integrals on each interval of the grid. Replacing those integrals by finite 
sums we are able to create more simpler schemes of accuracy 0(h 4 ) and 
0(h 6 ), whose coefficients can be expressed through the values of k, q and / 
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at some isolated points on each segment [x i _ 1 , x i+1 \. Such schemes permit 
one to retain the order of accuracy in the case of discontinuous coefficients 
k , g, / on the grids when discontinuity points fall into the nodes of 

the grid w h (I<). 

Exact and truncated schemes are quite applicable in the estimation 
of the accuracy of schemes (16)—(17) in Section 2. This approach allows to 
weaken or get rid of the smoothness of the functions k, q, f involved in the 
estimation of the accuracy order of schemes (16)—(17) in Section 2. 


3.8 METHODS FOR DESIGNING DIFFERENCE SCHEMES 

1. General remarks. From such reasoning it seams clear that in the space 
of grid functions difference schemes should retain the basic properties of dif¬ 
ferential equations such as self-adjointness, the validity of certain a priori 
estimates (for instance, the maximum principle), etc. Moreover, a scheme 
which interests us must satisfy, first at all, the requirements of solvability, 
stability, approximation and, hence, accuracy of a certain order; at last, 
an algorithm must be expedient in computer resources. The expediency 
depends not only on a scheme, but also on making a substantiated choice 
of the method for solving difference equations and a grid which, gener¬ 
ally speaking, may be non-equidistant and depends on the behaviour of a 
solution. 

The construction of schemes with the indicated properties and a de¬ 
sired quality is one of the outlines of the possible theory. 

As a result, a considerable amount of effort has been expended in 
designing various methods for providing difference approximations of dif¬ 
ferential equations. The simplest and, in a certain sense, natural method 
is connected with selecting a suitable pattern and imposing on this pattern 
a difference equation with undetermined coefficients which may depend on 
nodal points and step. Requirements of solvability and approximation of 
a certain order cause some limitations on a proper choice of coefficients. 
However, those constraints are rather mild and we get an infinite set (for 
instance, a multi-parameter family) of schemes. There is some consensus of 
opinion that this is acceptable if we wish to get more and more properties of 
schemes such as homogeneity, conservatism, etc., leaving us with narrower 
classes of admissible schemes. 

Actually this way has been demonstrated in Sections 1-3. Several 
methods find a wide range of applications in designing difference schemes 
of a desirable quality, among them 

1) the integro-interpolational method (see Section 2); 
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2) the variational difference methods (the Ritz method and Bubnov- 
Galerkin methods) and the finite element method; 

3) the method of the summator identity; 

4) the method of approximating a variational functional, 

2. The integro-interpolational method (IIM). In Section 2 we have already 
studied the IIM, but its possibilities and potential have not been illustrated 
in full measure. Here we consider other ways of its applications by appeal 
to the problem 


(1) ( ku')' — q(x)u = — f(x) , 0 < x < 1 , 

(2) k u! — <Tj u = — fi 1 , x = 0, —ku' — a 2 u=—fi 2} x=l, 

0 < Cj < k(x) < c 2! (Tj > 0, u 2 > 0, q(x) > 0 . 

We introduce an equidistant grid on the segment 0 < x < 1 

“h = i x i ~ ih > 2 = 0,1,... , TV, hN = 1} • 

Integration of equation (1) is accomplished over the segment x t < x < x i+1 , 
leading to 


x i -\-1 

(3) w i+i — w i = J (?« — /) dx = $j +1 , w = ku 1 . 

x i 

Here, in contrast to Section 2, the flow — w is taken at the same node x i 
as the unknown function u, which is sought. Therefore, the intention is to 
use instead of tiq +lj , 2 the approximation (w i+l -f w { )/2 by accepting 

( 4 ) \( w i+i +^i) ~ a i+l U S,l+l - 

where ci i+1 is some functional of k(x) on the segment x i < x < x i+1 satis¬ 
fying the relation a t = k(x i _ 1 j 2 ') + 0(h 2 ). In the course of the elimination 
of w { from (3) and (4) we find that 

w i +1 ~ a i +1 u x,i +1 + 2 ^ ! +l ' 

Subtracting from here the relevant expression 

Wi m a { i | 
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and taking into account (3), we establish 

( 5 ) (“«*)*,,- ~ tr +i = jh j dx ■ 

■H-l 

The approximation of the integral on the right-hand side of (5) can 
be done using various quadrature formulae, for instance, by the formula of 
trapezoids 

X i +1 

y (gw - /) dx Pd (gw - f)i 

x i -1 
or 

x i-\-l 

Yh j (gw- /) dx Pd i ((gw - /)*•-! +2 (cgw- f) z + (gw- /)j +1 ) 


= (g-» - f)i + y (gw - /kr,i • 

With these, we arrive at the schemes of accuracy 0(h 2 ): 

(6) (ay. t ) x - qy =-,f, 

(?) (ay x - (gy)^ - qy = -(/+ ^ fs x ) ■ 

To approximate the boundary condition, for instance, at the point 
x = 0, we apply (3) for i = 0 


wq - w 0 


h 


f(qu - 


f ) dx 


and then adopt here 


t,o +1 / (gw 
o 


/) dx , w 0 = (ku')o = Wj w 0 


a l W.i:,0 (°"l «o A 4 ! 


| /(gw- 


o 


/) dx . 


so that 
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Making use of the approximation 

h 

f (qu - f) dx & (qu - f) 0 h , 
o 

we impose the boundary condition for y i with the approximation error 
0(h 2 ) at the point x — 0: 

(8) «1 W,o = Vo - /h > d-j = cTj + i hq 0 , fl, = ^ | hf 0 . 

The boundary condition (2) of the third kind can be established at the 
point x = 1 in a similar way. 

So far we have studied some versions of the IIM on the basis of the bal¬ 
ance equation (the balance method). We now consider the second method 
for the design of homogeneous difference schemes by means of the IIM, in 
the framework of which equation (1) has to be integrated twice: first, we 
integrate equation (1) from x i to x: 


( 9 ) 


•j(x) — iu(x i ) = / (qu — f) dx 


Second, we integrate the preceding over x from x { to x l+1 and from x i _ l 


to Xi'. 


( 10 ) 


x 2 + l X 2 + l y X \ 

J w(x) dx — uq h = J dx l J (qu — /) dt 


(11) J w(x) dx — w i h = J dx i J (qu — f) dt \ . 

x 'i — 1 x 'i — 1 x i 

The interchange of the integration order leads to 

x i+\ , x k x i +1 

j dx ( j (qu - f) dt j = J (x i+1 - t) (qu - f) dt 


dx / (qu — f) dt 


(t - x i _ 1 )(qu - f) dt. 
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The function u(x) is linearly interpolated on each of the segments [x^j , xj 
and [Xj , x i+1 ], so that 


i(x) 


+ (x — x f ) u x i for x i < x < x i+1 
+ (x — Xj) u s i for x i _ 1 < x < x i 


which simplifies the huge job done with the integrals 


X 


i + l x i -\-1 x 'i + l 

w dx — I ku r dx & u x i f k(x) dx , 


> dx & u x i / k(x) dx 


J qu(t — x^j) dt K, — J q(t ) (t — Xj_j) dt 

H-l x i~ 1 

x i 

+ u s,i J q(t)( x i dt. 

X i- 1 

x i +1 x i +1 

J — c i u dt ^ Wj J ([(t) t) dt 


x i + l 

+ u x i J q(t) (x i+1 - t) (t - Xi ) dt 


Substituting the resulting expressions into identities (10)—(11) and sub¬ 
tracting the second identity from the first one, we arrive at the difference 
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scheme 


( 12 ) 


ai= h 


(aj/s)* -dy=-<p, 

x 'i 

j k(i) dt J rj(t) (z, - t) (t - dt 


ii = T? 


C x i x i + l 

j (t-x i _ 1 )q(t) dt+ j (x i+1 - t) q(t) dt 


The right-hand side tp i can be determined by the same formula as we used 
for d i with f(t) standing in place of q(t). The formulae for a i and d i can 
be rewritten as 


(13) 


U U 

J k(x i + sh ) ds + h 2 J s(l + s) q(x i + sh ) ds , 

-l -l 


o 

J (1 + s) q(x i + sh) ds 

-l 


l 

J (1 — s) q(x { + sh) ds . 
o 


If k and q are constants, then 


(130 


, 

«* = k- y q, 


di-q- 


In the sequel we will show that scheme (12) is identical with the scheme 
emerged in variational difference methods (the finite element method). 

In what follows we share our practical experience of the design of 
difference schemes for problems with lumped parameters by means of the 
IIM. Suppose, for instance, that a single heat source of capacity Q is located 
at a point x = £ so that a solution of problem (l)-(2) satisfies the conditions 



for x = £ . 


(14) 


[u] = 0, 
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Let £ = -f 9h, 0 < 9 < 1, that is, x n < £ < x n+1 , n > 0. The 
balance equation (3) on the segment x n < x < x n+1 is of the form 


w n+i ~ w n + [w] 


x n + l 

j (qu - /) dx 


or 

(15) w n+1 -w n - $ n+1 + Q . 

On the remaining segments [aq , x i+1 ], i zjz n, identity (3) holds true. As a 
final result, instead of (12), we get the scheme 

( a y.x) Xji ~ q i y i = ~Vi > 

where 


(16) 


Pi fi 


= f 

Jn 2 h 


i n, i z/z n + 1 , 


Pn +1 


= /, 


n + l 


Q_ 

2 h ' 


In the physical language, this is a way of saying that the source is spread 
over two intervals. 

Rewriting the same identity on the segment , ac J -_|_ 1 y 2 ] reveals 

another scheme 


(17) (^'Vx') x dy y? , Pn-\- 1 /n + l > P n fn T ^ 

for 0 < 0 < §, 

_ f ,Q _ f 

Pn -\-1 /n + l T ^ > Pn Jn 


for 1 < 0 < 1, 

Let us stress that the integro-interpolational method is a. rather flex¬ 
ible and general tool in designing difference schemes relating to stationary 
and nonstationary problems with one or several spatial variables. 
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3. Variational difference methods (the Ritz method and the Bubnov Ga- 
lerkin method). The Ritz and the Bubnov-Galerkin variational methods 
have had considerable impact on complex numerical modeling problems and 
designs of difference schemes. 

Let A be a self-adjoint positive definite linear operator in Hilbert space 
H equipped with an inner product (,) and let / be a given element of the 
space H. The problem of minimizing the functional 

(18) I[u] = (Au,u) - 2(u,f) 

is equivalent to the problem of solving the equation 

(19) Au = f. 

The element u Q £ H satisfying the equation Au 0 = / and realizing 

min I[u] = I[u 0 \ 


is unique. 

The main idea behind the Ritz method is to take into consideration 
a sequence of finite-dimensional spaces V n with basis functions ipf“\ i = 
1,2,... ,n, and look for an element u n £ V n , minimizing the functional I[u] 
in the space V n . 

Still using the framework of this method, we may attempt an approx¬ 
imate solution u n in the form 

n 

(20) = E Vj Vj 

7 = 1 

with unknown coefficients y 1 , y 2 , . . ., y n . By inserting this expression in 
the formula for I[u] we find that 

n n 

(21) I[u„] = J2 y i y j ~ 2 J2 E y j ’ 

1,7=1 7 = 1 

where 

( 22 ) a tj = (Aifi Pi = (/, ifii), 

Since A = A* is a self-adjoint operator, we have — a^. The functional 
I[u n \ is a function of n coefficients y 1 , y 2 , ., ,, y n . By equating the deriva¬ 
tives dl[u n \/dyi to zero and using the symmetry of coefficients = a^, 
we obtain n equations for determination of y { : 

n 

^ ( ®ij Vj Pi 0, 

7 = 1 


(23) 


i — 1,2,... ,n . 
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The Ritz method proves to be useful in studying the problem 
(24) (ku')' — qu = —f(x), 0 < x < 1, u( 0) = 0, u(l) = 0 . 

Other ideas are connected with the function 

0, s < -1, s > 1 , 


(25) 


T](s) = <( 1 + S, —1 < S < 0 , 

1 - s, 0 < s < 1 , 


which guides the choice of the functions 

(26) = Vi( x ) > 

where x i = ih, i = 1,2,... , TV — 1, is a node of the grid w h = {x { = ih, i = 
0, 1,. .. , TV, hN = 1}. It follows from the foregoing that 


0 


for x < and x > x i+i 


+i ’ 


X — X: 


( 25 ') riiW = 


and, hence, 


h 

x i -\-1 x 


(27) 


d-Vi 

dx 


for < x < x { , 

for x i < x < E i+1 , 


0 for x < and x > x i+1 , 


= S h 


for Xj_. < x < X: 


— - for x, < x < X,-, . 
h 1 1+1 


Upon substituting 


d ( du\ 

Ait = [k — + qu 

dx \ dx / 


into (22) we get 


drji drjj 


(28) a t j = H k -A- + qiiiTjjj dx , A = / f(x) Vi (x) dx . 


0 



Methods for designing difference schemes 


223 


In light of the properties of the function r/^x) and its derivatives the matrix 
{a^} is tridiagonal, because only the elements with j = i — 1, j = i and 
j = i + 1 are nonzero. 

In the new notations 

(29) a i = -ha i:i _, , h 2 d l = h a i { + h + a i i+1 ) 

we obtain 


0i= h 


' v l *1 

J k(x) dx — — J q(x) (x — x i _ 1 ) ( x i — x) dx . 


(30) 


di= V 


C x i tl i +1 \ 


Then the system of equations 

a iti _ 1 y i _ 1 + a hi Vi + a i i+1 y l+1 - /3 { - 0 
can be rewritten as 

a i Vi- 1 - K + a i+i + h2d i ) Vi + a i+ 1 Vi+i + h 2 <Pi = 0 


or 

(31) {ay t ) x - dy = -ip , 

where 


/' X i x i+i 

(32) <Pi = f j f(x) (x - Xi _,) dx + J f(x)(x i+1 - x) dx 

x i -1 x i 

thereby clarifying that ^ are calculated by means of the same formula as 

d i- 

So, the three-point scheme (30)—(32) constructed by the Ritz method 
is identical with scheme (12) obtained by means of the IIM, In contrast 
to the Ritz method the Bubnov-Galerkin method applies equally well to 
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problems, whose ingredients have no fixed sign and turn out to be non-self- 
adjoint. In this case the coefficients y i of the approximate solution (20) are 
to be determined from the orthogonality conditions for the residual Au n — f 
with respect to all of the basis functions ?q(x); 

(33) (Au n - f,r)i) = 0, i — 1,2,... ,n. 

A non-self-adjoint boundary-value problem acquires the form: 

( ku') 1 + r(x) u! — q(x) u = —f(x) , 

(34) 0 < x < 1, w(0) = w(l) = 0, 

k{x) > 0, q(x) > 0. 

We introduce the grid u> h = {aq = ih, i — 0, 1, . . . ,7V, hN = 1}. Then the 
dimension n of the space V n equals TV — 1. The functions 

Vi( x ) = v( X i = 1, 2, ■ ■ ■ ,7V - 1 , 

where the function rj(s) was specified by (25), provide the background for 
subsequent constructions. 

In this context, condition (33) becomes 


(35) 

N-l 

J2 a n y j ~ 11 

>< = o, 

7 = 1,2,. 

.. ,7V- 1, 

where 

7 = 1 





a ij = j ( K X ) r ( X ) Vj ( X ) + ?(*) Vi(x) Vj( x )) dx . 

0 

(36) 

1 

Pi = j fi x ) Vi( x ) dx . h j = !, 2, ■ ■ ■ , TV - 1 . 


o 

By definitions (25), (25') of the function ?q(x), the coefficients oq j are 
nonzero only for j — i — 1, 7, 7+1. Retaining notations (30) for a i and d i 
and (32) for <p i and accepting 


b~ = 


h 2 


-1 


( 37 ) 


"•t+i 


h t = / r ( x ’) ^i+i _ x ) dx = / r ( x i + sh) (l - s) ds , 


o 
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we reduce the system of equations (35) with the members 6 + and b to 

(38) ^ K+i (y i+ 1 -Vi)- a-i (Vi - %_i)] 


h (Vi-Vi-i) , h f (Vi+i-Vi) 


~ d-iVi = ~fi 


i = 1, 2,. .. , N - 1 . 

Thus, we arrive at the difference scheme 


(39) 


{ a Vx) x + b Vx + b+ Vx - dy= -<p(x), 0 < X = ih < 1 , 

= 0, ?/jy = 0, 


whose coefficients can be recovered from (30), (31) and (37). 

For r(x) = 0 this scheme is identical with scheme (31)—(32) obtained 
by means of the Ritz method. In the case of constant coefficients k(i c), r(;r) 
and q[x) 


l h2 

a-i = k - — q, 
o 


d ; = d 


b. = b + = -, b . + 6 + y = 

? ?. o' r ' i. &X 


r y° 


When the coordinate functions <Pi(x) = 77 ((x’ — x t )/h'j are chosen by 
an approved rule as suggested before, the Ritz and the Bubnov-Galerkin 
methods coincide with the finite element method. 

4. The method of approximating a quadratic functional. The boundary- 
value problem 


Lu = ( ku')' — q(x)u = —f(x), 0 < x < 1, w(0) = 0, u(l) = 0 , 

is equivalent to the problem of searching a minimizing element for the 
functional (see Section 3) 


1 


1 


(40) 



fu dx . 


0 0 

Recall that the equation Lu = —f(x) is Euler’s equation related to such a 
functional I[u], 
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We introduce the grid u> h = {xj = ih, i = 0,1,... ,7V, hN =1} and 
approximate on it the functional /[u] by appeal to one of the auxiliary 
modifications 


n«] = x; 7 k(u') 2 dx + / ( qu 2 — 2 fu) dx . 

J 'l — 1 —1 

With this in mind, we approximate the integrals 

x i 

l k(u') 2 dx sx ai {u SJ ) 2 h , 


(qu 2 - 2 fu) dx m - ((qu 2 - 2 fu)i + (gw 2 - 2/w) i _iJ , 


where a s - is a functional depending on £;(x) on the segment x i _ 1 < x < x i . 
There are many ways of taking care of these restrictions. For instance, we 
might agree to consider 


J k(x) dx , etc. 

*! — 1 

Thus, instead of I[u] we deal with the functional 
N N -1 

(41) I h [u] = J2 a i (%,i) 2 h +Yl (5i Vi ~ 2 fi Vi) h : 


A 


i = 1 


i = 1 


where y is an arbitrary grid function vanishing for i = 0 and i = N: 
y Q — y N — 0. The functional 7/Jw] is a function of N — 1 variables y 1) y 2) 
. . ., y N _ 1 . Equating the first derivatives 

Cj T 

~g^ = 2 a i +1 y x ,i(~ 1 ) + 2 a i y s ,i + 2q l y l h~2f i h 


to zero leads to the difference equations 
(42) (ay s ) x - qy =-f(x) , 


x = ih. 
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Adopting those ideas to problem (1), (2), (14) concerning a point heat 
source, an excellent start in this direction is to replace the function f(x) 
involved in formula (40) by f(x) + S(x — £)Q, where 6(x — £) is Dirac’s 
delta-function. Recall that S(x — ^) = 0 if x yf £, 6{x — £) = oo if x — £ and 
f^-e H x ~ 0 dx = 1 for any e > 0. As a final result we get 


(43) 


I[u] 


1 

J [k(u') 2 + q u 2 — 2 fu] dx — 2Qu(£,). 
o 


If £ = x n + 9h, 0 < 9 < 1, then w(£) must be replaced by u n for 9 < A 
and by u n+1 for 9 > A, whose use permits us to establish 


(44) 


N N-l 

h[u\ = Y a i ( yx,i) 2h + Y ( d * y2 ~ 2 ^yi) h > 

i — l i —1 


where 


(45) 


, , Q , 

Ji + °i,n 

for 

9 < \ 

f m Q c 

Ji + h °i , n + 1 

for 

9>\ 


and 8 ik is, as usual, Kronecker’s delta. Equating dlhldy i to zero we arrive 
at the scheme (ay s ) x — dy — —ip with the right-hand side specified by 
formulae (45). 

In the case of a non-equidistant grid ui h — {x i , i = 0, 1,... , N, x 0 = 
0, x N = 1} we obtain instead of (44) 


N N -1 

h[y\ = Y a i (y^,if h i + Y ( d i y 2 i ~ 2Lp i Vi) h i 

v i ~1 i — l 


In particular, it is always possible to choose a grid so that £ = x n would be 
one of the nodal point and 

Vn — fn d" 7 ) Vi ~ f i > 2 yf . 

n n 

We are led by equating the derivatives dlh[u]/dyi to zero to the scheme 

(46) (ay^i.i ~ d t: y, = -ipj , 


i = 1 ,2,. .. , TV - 1 
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5. The method of the summator identities (the method of approximating 
an integral identity). A solution of the problem 


(47) 


Lu — ( ku , y — qu — —f(x) , 0 < x < 1 , 

kid — (7 y u — /.ij , x — 0, — ku f — a 2 u — qt 2 , x — 1 , 


satisfies the integral identity 
l 


(48) I[u ) v ] ~ J {kit 1 v' + quv — fv) dx + u( 0) v(0) 

o 

+ ^2 w(l) K 1 ) - /A K°) - K 1 ) = 0 . 


where v = v(x) is an arbitrary function being continuous on the segment 
0 < x < 1 and having the summable derivative in the space j^ 2 [0, 1], This 
identity will be used for the determination of the generalized solution of 
problem (47). 

The design of a difference scheme on an equidistant grid ui h = {x { = 
ih, 7 = 0,1,... , TV, hN = 1} is based on the approximation of the integral 
identity (48) by the summator identity for grid functions, for instance, 

N N-l 

(49) I h [u, v] = ^ , h + ( ?i Vi - ) v { h 

i -1 i—1 

+ dj Vo v o + d 2 y N V N — v 0 — V N = 0 , 


where v i is an arbitrary grid function. Here a t is any of the coefficients 
having the form = A[k(x { + sh)], — 1 < s < 0, and providing an approx¬ 
imation of order 2: a, = k i _ 1 j 2 + 0(h 2 ). There is no difficulty to verify 
that 

a 1 = a 1 + \ h q 0 , a 2 = < 7 , + \ h q N , 

= ffl + 2 ^0 1 k-2 — k-2 \ h f N 


if the trapezoids formula is in hand in computing the integrals 


(qu — f) dx 
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by means of the relation 
h 

[ 1 1 

(qu- f) dx = - h ( qu - f) 0 + - h ( qu - /) i , 

o 

etc. Accepting, for instance, iq = s - , 0 < i 0 < N, and recalling that 
% i = 0 for i < i 0 and i > i 0 + 1, v s io = l/h and v s ,; o+1 = — 1 /h, we find 
for i = i 0 that 

1 y%,i Q'i 
h h 

or {ay s ) x - dij = -/, 

If 0 , then v s , = (—l//i) < 5, t and identity (49) yields 

(-l/h)a iys l + <7j y 0 - y, = 0 
°r a 1 y Xi i = y 0 - y 1 . Likewise, for v { = S i N 

~( a y^) N - vn - y 2 ■ 

With these, we arrive at the difference boundary-value problem 


h + ( d i Vz ~ fi) h ~ 0 


( a Vs) x ~dy= ~f, 0 < x = ih < 1 , 

a i 2A-, o = 2/o — Ah i ~ a N y x ,N = yN — Fh 


3.9 STABILITY WITH RESPECT TO COEFFICIENTS 

1. Stability of difference schemes with respect to coefficients. In solv¬ 
ing some or other problems for a differential equation it may happen that 
coefficients of the equation are specified not exactly, but with some error be¬ 
cause they may be determined by means of some computational algorithms 
or physical measurements, etc. Coefficients of a homogeneous difference 
scheme are functionals of coefficients of the relevant differential equation. 
An error in determining coefficients of a scheme may be caused by various 
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factors: an error in calculations of pattern functionals, an error in specifying 
coefficients of a differential equation, rounding errors, etc. 

We say that a scheme is stable with respect to coefficients (co¬ 
stable) if a solution of the boundary-value problem has slight variations 
under small perturbations of the scheme coefficients. In order to avoid 
misunderstanding, we focus our attention on the scheme with coefficients 
a, d, p 

(1) A y = {ay s ) x -dy =-ip, Q<x = ih<l, y( 0) = 0, y(l) = 0 , 

and the same scheme with perturbed coefficients a, d, <p (for the sake of 
simplicity the values y( 0) and y(l) remain unperturbed) 

(2) Ay = {dy s ) x -dy = -<p , 0 < x = ih < 1 , y( 0) = 0, y(l) = 0 , 

under the conditions 


(3) 


a(x) > c 1 > 0, a(x) > Cj > 0, 
d(x) > 0, d(x) >0, Cj = const > 0 , 


with constant c l independent of a grid. 

We estimate the difference z — y — y in terms of perturbed coefficients. 
Substituting y = z + y into (2) and taking into account (1), we get 

(4) ~kz = {az s ) x -dz = -W, z 0 = z N = 0 , 


where 


(5) W = <p - p + (A — A) y = (p — p + ((5 - a) y s ) x - (d-d)y. 
From (4) it is easily seen that dt is representable by 

( 6 ) . 'S = y, x + t] x , 


where 

(7) fi = (a — a) y s 

and y is determined from the conditions tj x = <p — p — (d — d)y and •q 1 = 0, 
so that 


( 8 ) m 


i—1 

E h [ifik - Ph) ~ ( d k - d k)vk], 

k= 1 


i = 2, 3,... , TV, ~ 0 
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To evaluate a solution of problem (4)-(7) on the basis of (6)-(8), we 
rely on the estimate obtained in Section 3 for (4)-(7), making it possible 
to establish 

II 2 He ^ 7“ U 1 ’ I “ a ) 24 I] + ( ! > I ?? I ]} • 

C 1 

We shall need the estimates for y and y T from Section 6 such as 

\\y s \\ c <y U.M)- 

Cj c 2 

Combination of the inequalities 

U> hi] < (!, I v I] + (C d \) \\y\\c < U> I ? ?l] + — (1, I d- d\)(l, \p \), 

C 1 

where = E KVk ~ ¥>&), = 0, i ~ 2, 3,... , TV, and 

kz rl 

(1, | (a - a)y s |] < ^ (1, | 9 I) U> I « “ « I ] 
gives the estimate 

(9) ||jf-J/|| c < ^{(l,\v\} + ^(h\v\)((h\d-d\) + (l,\~a~a\])}, 

here y i is a solution of problem (1) and jq is a solution of problem (2), 
provided conditions (3) hold. 

Relation (9) can be replaced by a more rough estimate 

( 10 ) l|j/-y|lc < — {(C II 11+— (Cl v\) ((M d~d\) + (l, | a-a|])|. 

Cj c Cj j 

If 

(1, I V I ) = p{h) , (1, I a - a |] = p(h) , (1, | d - d |) = p(h) , 

where p(h) —> 0 as h —*■ 0, schemes (1) and (2) are said to be co-equivalent 
and for p(h) = 0(h m ) they are of the rath order of the co-equivalence. 
If schemes (1) and (2) are co-equivalent and scheme (1) is convergent, then 
so is scheme (2). This fact follows immediately from the inequality 

\\y-u\\ c <\\y~y\\ c +\\y-u \\ c —>0 as 0. 

The co-equivalence property of homogeneous schemes lies in the main idea 
behind a new approach to the further estimation of the order of accuracy 
of a scheme: on account of (9) or (10) its coefficients a, d, ip should be 
compared with coefficients a, d, ip of a simple specimen scheme, the accuracy 
order of which is well-known (see Section 7). 
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2. Stability of the first kind operator equations with respect to coefficients. 

Here we give the general formulation of the concept of stability with respect 
to coefficients for the difference scheme in Section 1 by having recourse to 
an operator equation of the first kind 

(11) Au = f, f €H , 

where A is a linear operator acting from Hilbert space H into H , A: H —> 
H, f £ H is a given vector, u £ H is the unknown vector. 

Problem (11) is said to be well-posed if there exists a unique solution 
of equation (11) for any / £ H and this solution continuously depends on 
the right-hand side /, so that 

(!2) \\u - u 11(1) < M 0 \\ f - f || (2) , 

where u is a solution of equation (11) with perturbed right-hand side / 

(13) Au = f, 

here II ' ll(i) an d II ' 11 ( 2 ) are some suitable norms on the set if, 

A case in point that in the statement of problem (11) we must specify 
not only the right-hand side, but also the operator A. If, for instance, A is 
a differential or difference operator, the coefficients of the equation should 
be known in advance. 

It is natural to require a solution of problem (11) to depend con¬ 
tinuously not only on perturbations of the right-hand side, but also on 
perturbations of the operator A (for instance, on the coefficients of a dif¬ 
ference operator). As in the case of difference schemes arising in Section 1, 
this property of operator equations is to be understood as stability with 
respect to coefficients or co-stability of an operator equation. 

The stability of a solution to equation (11) with respect to perturba¬ 
tions of the right-hand side / and perturbations of the operator A is called 
strong stability. The problem statement here is as follows: with regard 
to the equations 

(14) Au = /, Au~f , 

where A and A are linear operators, whose domains coincide with the entire 
space H, f and / are arbitrary vectors of the space if, it is required to 
estimate the perturbations of a solution 


(15) 


z — u 


u 
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via perturbations of / and A. 

Suppose that the inverse operators A~ l and A -1 exist. Moreover, we 
assume that A and A are self-adjoint positive operators. Substitutions of 
u = A -1 / and u — A -1 / into (15) yield 

(16) z = A~ l f - A” 1 / = A- 1 (f - f) + (A” 1 - A” 1 ) f , 

Applying A 1 / 2 to both sides of equality (16) we find that 

A 1 ! 2 z = AT 1 ! 2 (/ — /) + A 1/2 (A -1 -A~ x )f . 


We will estimate the vector 2 in the norm ||z||^ = \j(Az,z) of the 
space H^ together with the same things for / and / in the negative norm 
H/llj-i = \J (A -1 /, /) of the energy space H^_ L . Via transform 

A 1 ' 2 (A” 1 - A^ : )/= (E - A 1 ! 2 A- 1 A 1 ' 2 ) (A” 1 ! 2 f) 

we obtain 

(17) || A 1 ! 2 (A -1 — A -1 ) / || < \\(E^A 1 / 2 A~ 1 A 1 / 2 \\ ■ || A~ 1/2 f ||. 

As a measure of perturbations of the operator A we adopt a relative vari¬ 
ation of the energy (Ax, x ) of the operator A. The meaning of this is that 
we should have for all x £ H 

(18) j ((A — A) x, x) j < a (Ax, x), a>0, 

whence it follows that 


(19) (1 - a) A < A < (1 + a) A, 

(20) (1 - a) A- 1 < A” 1 < (1 + a)A~ 1 . 

Observe that (20) is an immediate implication of (19). To make sure 
of it, we compose the difference J = (1 + a)(Ax,x ) — (Ax,x) and insert 
A 1 / 2 ® = y: 


J = (1 + a) || y || 2 - (A 1/2 AA 1/2 y, y) = (1 + a) || y\\ 2 - (Dy, y ) , 
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where D =■ A l l 2 AA '/ 2 , and, after this, pass to D l ! 2 y = z\ 
J = (l + a)(D~ 1 z,z)-\\z \\ 2 
= (l + a)(A^ 2 A- 1 A 1 / 2 z,z)-\\z \\ 2 
— (1 + a) (A~ 1 v , v) — (A~ 1 v, v) = A 1 ! 2 z . 


As far as J > 0, we have (1 + a) A 1 > A 1 , thereby justifying that 
for any operators A = A* > 0 and A = A* > 0 the inequality A -1 < 
(1 + a)A -1 follows from the inequality A < (1 + a)A, Moreover, we claim 
that inequalities (20) are equivalent to 

(1-a)E < C < (l + a)E, C = A 1 ! 2 A -1 A 1 ! 2 , 

Indeed, 

(1 + a) (A -1 x,x) — (A -1 a:, x) — (l + a)||i/|| 2 — (A 1 / 2 A -1 A 1 ^ 2 y, y) 

= ( 1 + a )ll^ll 2 - (Cy,y) > o. 

Thus, (18) implies that —aE < E — C < aE and C = A 1 ^ 2 A~ 1 A 1 ^ 2 . 

By the definition of the norm of self-adjoint operator, 

|| if - C || = II £- A l l 2 A- 1 A 1 l 2 \\ < a . 

Substituting this estimate into (17) we deduce from (16) that 

II^IU-<ll/~/IU-- 1 +«ll/IU -- 1 

or, what amounts to the same, 


II«-«IIa < II/-/IIA - 1 + a ll/ll a - 1 


If we are in possession of an operator Aq ;= Aq of rather simplified 
structure than the operator A satisfying the condition A > cqAo, c 1 > 0, 
then 


A " 1 < -Aq 1 , 
A 


I/Hj-i < — 11/ 


provided the inverse A 0 1 exists. Thus, we have proved the comparison 
theorem. 
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Theorem Let u he a solution to equation (11) and u he a solution to 
equation (14), where A, A and Ao are self-adjoint positive operators for 
which the inverse operators exist. If condition (18) and the inequality 
A > Cj-Ao, Cj > 0 hold, then the estimates are valid: 

(21) \\u-u\\ x <|| f-f ll^-i + a || / H^-i , 

(22) ll«-«»,„< (-11/-/II,-. + } ll/ll,,-. • 

L 1 L 1 

The first summand on the right-hand side of (21) is the value of pertur¬ 
bations of the right-hand side / and the second one involves the coefficient 
a, which is the value of a relative perturbation of the operator. 

Example Let H be the set of all grid functions defined on ui h = {aq = 
ih, 0 < i < TV} and vanishing for i — 0 and i — N. We refer to the 
difference operators 

Ay = -(ay s ) x + dy, a > C] > 0, d > 0 , 

Ay=-{ay s ) x + dy, a > c 1 > 0, d> 0, 

A oy = -y £x ■ 

By introducing the inner product in the usual way and applying Green’s 
formulae we get the inequalities A •> c x Aq and A > c 1 Aq. In conformity 
with Chapter 2, Section 5, 

, N -1 , N -1 . 2\ 1/2 

ll/IL- < II/ll ( „ i;) = ( £ h ( E hf k ) ) , feH. 

With these relations established, estimate (22) reduces to 

umi<f ii/'-/ii ( . 1) + f ii/ii,.,, 

or, on account of the inequality || 2 || c , < } || z s ||, 

Ibllc ='|]S-»II C < 2^ll/-/ll ( _ 1) + 

In concluding this chapter we clarify the meaning of condition (18) by 
observing that 

(1 - a) (( a,yl\ + ( d,y 2 )) < (d,yl\ + ( d,y 2 ) < (1 + a) {{a f y 2 s } + (d,y 2 )) . 
From such reasoning it seems clear that the fulfilment of (18) is ensured by 
the inequalities 

\d — a\ < aa , \d— d\ < ad. 




Difference Schemes 
for Elliptic Equations 


This chapter is devoted to various difference approximations of second-order 
elliptic equations. In Sections 1-3 we present results of more a detailed ex¬ 
ploration of the Dirichlet difference problem for Poisson’s equation. The 
approximation technique for the Laplace operator and formulations of dif¬ 
ference boundary conditions are described for regions of arbitrary shape. 
The maximum principle (Section 2) and all of its corollaries are established 
for grid equations of common structure. These tools are aimed at establish¬ 
ing the uniform convergence with the rate 0{\ h | 2 ) for the difference scheme 
constructed in Section 1 for the case of an arbitrary domain. In Section 4 
we study the properties of the difference Laplace operator and develop the 
difference operators corresponding to elliptic operators of general form with 
variable coefficients'. In Section 5 higher-accuracy schemes are designed for 
Poisson’s equation in a rectangle. 


4.1 THE DIRICHLET DIFFERENCE PROBLEM 
FOR POISSON’S EQUATION 

We now turn to the design of difference schemes for solving the Dirichlet 
problem in which it is required to find a continuous in G + T function u(x) 
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solving the Poisson equation 

p pa, 

(!) Au =J2d^ = -f ( - x ')’ x€G 

or = l U Q 

subject to the boundary condition 


»l r = K x ). 


where x = (x i ,x 2 ... ,x p ), G is a p-dimensional finite domain with the 
boundary T. 

1. The difference approximation of the Laplace operator. We begin by 
defining a difference analog of the Laplace operator in the plane x ~ 
(x i , x 2 ) - 


( 2 ) 


Am = Li m + L2 u , 


L a u = 


d 2 u 

dxl 


a = 1,2. 


a 2 2 , 

In this direction the operator L\ u — f-4- or L 2 u = 1-4 is approximated at 

u iC ^ u tV ^ 

a point x — (xq , x 2 ) by the three-point operator A x or A 2 , respectively: 



where approximation is denoted by the symbol ~ and h i > 0, h 2 > 0 are 
the steps along the axes x i and x 2 , respectively. 

The operators'Ai and A 2 are specified on the regular three-point pat¬ 
terns 

(x 1 -h 1 ,x. 2 ), (x 1 ,x 2 ) (x 1 +h 1 ,x 2 ) 

and 

(x 1 ; x 2 ^2)’ (*^1 > x2) (x[ ; x 2 -)- /I2) > 

respectively. Taking into account (3) and (4), we replace the Laplace oper¬ 
ator (2) by the difference operator 
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Figure 6. The regular “cross”-pattern 

which is defined on the five-point pattern consisting of the nodes (aq ± 
h 1 , x 2 ), (Xj ,x 2 ), (xj , x 2 ±/i 2 ). Any such regular pattern is called a “cross” 
pattern and is depicted in Fig. 6. 

Here the symbol O corresponds to the point (aq , x 2 ), while the symbol 
1 corresponds to the point (aq + h 1 ,x 2 ), etc. 

From formulae (3)-(5) and Fig. 6 it follows that 

1 1 

(6) A v 0 = (vj - 2 v 0 + v 3 ) + — (v 2 -2v 0 + v i ). 

In particular, for h T = h 2 = h (on any square pattern) we thus have 

(7) A v 0 = ^2 (vj + v 2 + v 3 + v 4 — 4 v 0 ). 

The next step is to calculate the error of approximation of the Laplace 
operator (2) by the difference operator (5). Since for a — 1,2 

a ex 

(see Chapter 2, Section 1), it is plain to derive the expression 

A ^ - A v =^L 2 1 v + ^Llv + 0(hf + hi ). 


This provides support for the view that 


A v — A v = O ( \ h \ 2 ), \h\ 2 = h 2 1 +h 2 2 , 
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if v(x) is an arbitrary function having no less than four derivatives with 
respect to r 0 , a = 1,2, that are bounded at least in the rectangle {x a — h Q < 
x 1 < x a + h a ] a = 1,2} for h a < h a . So, the Laplace operator (2) is 
approximated to second order by the difference operator (5) on a regular 
“cross” pattern. A difference approximation of the p-dimensional (p > 2) 
Laplace operator 


( 9 ) 




L a u = 


d 2 u 
dx 2 


can be arranged in just the same way. This can be done by replacing L a 
by the three-point difference operator A„ and accepting the decomposition 

p 

(10) Av = J2 A * v > A « v = v SaXa , 

a = 1 

so that 

(H) A a v = v SaXa = ^ ~2v + , 

a 

where = n(x( ±lcA ). Here x( +lcA (or x^ -1 ")) is a point into which 

the point x = (x 1 , ... , x ) moves after the shift by one interval h a along 
the direction x a to the right (or to the left) (see Fig. 7). 


x X+ 1 " 

-e-e— 


Figure 7. 

Evidently, the pattern for operator (10) consists of 2p + 1 points: x, 
x( ± 1q ), a = 1,... ,p (7 points in the case p = 3) and the approximation 
here is of order 2. 

2. Approximation of the Laplace operator on an irregular “cross” pattern. 

We now consider a difference approximation of the Laplace operator on 
an irregular “cross” pattern. In the two-dimensional case (p = 2) such a 
pattern consists of the five points 

(Xj /l}- 5X2), (x j T h^+ 5X2), (x'j 5X2), (Xj ,X'2 ^2--)) (Xj 



The Dirichlet difference problem for Poisson’s equation 


241 



Figure 8. The irregular ’’cross” pattern 

where /i 1± > 0, /t 2 ± > 0 and ^ a+ 7 ^ h a - at least for one value of a (Fig. 8 ). 
We approximate either of the operators Ly and L 2 at three points 

(xj — hy- ,x 2 ), (x 1 +hy+,x 2 ), (xj , x 2 ) (the points 3,1,0), 

(xj , x 2 — h 2 - ), (xj , x 2 + h 2 +), (xj,x 2 ) (the points 4, 2,0), 

respectively. These approximations can be arranged via transformations 
(Chapter 2, Section 1) such as 
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If, for instance, /q- = h^+ — h ll then A* v = Ait; = v s £ , etc. The 
procedure of writing out the arguments is somewhat cumbersome. This is 
especially true for the case p > 2. To make our exposition more transparent, 
it will be sensible to introduce the notations 

jd+ii) _ _|_ /j 1+ j aV 1 !) = (x 1 — hi- , x 2 ), 

x (±i2) _ h 2 ±), 

v (+ 1 <*) = v ^x( +1 “) j , v = v(x), — v , a =1,2. 

The disposition of the points x and is shown in Fig. 9. 


^ ot X ' 

-e-e- 

K- h a + 

Figure 9. 

The expression for A* a can be rewritten as 


n + U 


(14) 


Mv - 


,;( + lof ) _ 


V V — V 






K — 2 (J^a~ H - ^o-+)? — 1,2. 


In Chapter 2, Section 1 (see formula (27)) we have approved the expression 
for v$£ — v 11 , whose use permits us to establish 


(15) 


A* v - L a v ~ ~ (h Q + - h a ~) J-X + 0(hl). 


Thus, on any irregular pattern the Laplace operator is approximated to 
first order by the difference operator A* specified by formula (13). 

The approximation of the type (12) applies equally well to a non- 
equidistant grid and at the near-boundary nodes in the case of an arbitrary 
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domain. We follow the second way of approximating the Laplace operator 
on an irregular pattern (see Fig. 8). The expression 


(16) A* v 


,,( + !<») _ 


V V — V 


(- 1 «) 


h a = max(/i a _ , h a +), 


reveals A* instead of formula (14) as 


A * Of 

° v ~ TT VSa 


We claim that in this case the operator A* generates the local approxima¬ 
tion of zero order 

4>a = A a U - A a U = 0(1) . 

Indeed, taking into account (15) we arrive at the chain of the relations 


V> a = u - A a u = - |^1 - j L a u 

+ ft Q (/la+ “ h °-) + 

= ± K 1 _K Z _ LaU + o(h Q ) = 0(l). 

We clarify the situation, in which approximation (16) is quite applicable, 
on the basis of one possible example. 

Example For the boundary-value problem 

u" = —fX x ) , 0 < x < 1 , «(0) = 0 , w(l) = 0 , 

we form the grid 

^h — {*0 > X 1 — ^1 > x i T 2 1,2,... , TV 1, 1 x N ^ 2 } , 

which is everywhere equidistant, but near the boundary h l < h, h 2 < h, 
h 1 + h 2 + (TV — 1 )h = 1. At the regular nodes x iy 1 < i < TV, we find that 
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By the same token, 


rt" ~ A*«j = - 


// i * i 

J>jy ~ A Ufj — — 


u 2 — u 1 rq — u 0 


U N +1 ~ M jV ?tjy — »jy-i 


h 2 h 

With these relations established, we arrive at the difference scheme 


yxx = -f( x ), x { ~ h 1 + (i - 1) h , 1 < i < N , 

(17) 

^ Vi ^ Vn /( x w) ! Vo Vn+1 ^ , 

which will be convenient to be expressed with respect to the error 2 = y — u: 

(18) Az = -ip(x), 0 < x < 1, z 0 = z N+1 = 0 , 

where Az — z?„ for x. < x; < x N , Az, = A*z, and A z N — A*z N , ib,- = 
0(h 2 ) for i - 2,3,... ,7V - 1, ^ = 0(1) for i = 1,7V. 

In spite of the fact that this scheme generates no approximation at 
the near-boundary nodes i — 1 and i — TV, scheme (17) is of second-order 
accuracy in the space C: || 2 || c = 0{h 2 ). In order to obtain this estimate 
at the points x = aq, x N , we rewrite equation (18) as 



where z 0 = hh 1 ip 1 and z N+1 = hh 2 ip N . Thus, problem (18) is equivalent 
to the following one: 


z Sx = —if>(x), x 1 < x < x N , A* z 1 = 0 , A*z N — 0 , 

, z 0 — h h 1 tp 1 , z n+ 1 ~ h ^2 V’w • 

On account of the a priori estimate 


N i 

II * lie < maX (I *0 I. I Z N + 1 I) + E h E h I 4>k I . 

i -1 k =1 

arising in Section 2 of Chapter 1, it is easily verified that 

II Z lie = II y - u He < h h i I Vh I + h h 2 I 4>n I + ^ax, | 4>i | < M h 2 . 
This means that scheme (17) provides an approximation of order 2. 
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Figure 10. 


3. The Dirichlet difference problem in a rectangle. Let now 

Go = (0 < < G , 0 < x 2 < l 2 ) 

be a rectangle of sides l ly l 2 (see Fig.10) with boundary T. 

Of our initial concern is the Dirichlet problem in the rectangle Go = 
Go + T for the Poisson equation 


(F) Am = —f(x), x = (x 1 ,x 2 )&G o, u\ r = n(x). 

In order to form in G'o the grid u> h with steps h 1 = /j /TV i and h 2 = l 2 /N2, 
where TVi and TV 2 are positive integers, we draw up two families of straight 
lines such as 


P (h) 


h h i > 


= 0,1, 


.TVj, 


G ta) = i 2 h 2 , i 2 =. 0, 1, ... , TV 2 . 


We call the points of intersection x = {i 1 h 1 ,i 2 h 2 ) of those straight lines 
with the coordinates i 1 h 1 and i 2 h 2 nodes. If a nodal point x = ( i 1 h 1 ,i 2 h 2 ) 
is inside the rectangle, that is, 0 < i 1 < N\ , 0 < i 2 < TV 2 , it falls within 
the collection of inner nodes. Let u> h be the set of all inner nodes. The 
total number of inner nodes is equal to (TVi — 1)(TV2 — 1). 
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The nodes on its boundary (for i 1 = 0,N\ or i 2 = 0,-/V2) except for 
four points (0,0), (0,/ 2 ), (/ 2 ,0), (/ 2 ,/ 2 ) are called boundary nodes and 
are labeled crosses in Fig.10. They constitute the set j h = {(ij/q ,i 2 h 2 )}. 
The set of all inner and boundary nodes is known as the grid ui h = ui h + j h 
in a rectangle Go- 

Following established practice, at each of the inner nodes x £ u> h we 
compose a five-point regular “cross” pattern, whose nodes x± la , a = 1,2, 
belong to u> h , that is, either to w h or to j h . For this reason at all inner 
nodes the Laplace operator Am can be replaced by the difference operator 


Am 


U X 1 X 1 T U X 2 X 2 ■ 


In this view, it seems reasonable to approximate the right-hand side —f(x) 
of equation (1') by the grid function —<p(x) so as to achieve the error p(x) — 
f(x) = 0(| h 2 |), f(x) £ C ( 2 ). Assuming the function f(x) to be continuous, 
in what follows we accept <p{x) = f(x). 

As a final result problem (1') is associated with the Dirichlet difference 
problem relating to the determination of a grid function y(x) defined on 
the grid u> h , satisfying at the inner nodes, that is, on ui h the equation 

(! 9) A y = -f(x), ^y = yx 1 x 1 +Vx 2 x 2 , x<Eio h , 

and taking the assigned values on the boundary j h 

(20) y(x) = y,(x), x £ j h . 

It is worth noting here that the grid cu h (Go) becomes rectangular for 
h 1 xjx h 2 . In the case where h 1 = h 2 = h it refers to a square grid. More 
a detailed expression for Ay on any square grid is of the form 


Ay 


M yi+li) 


y 


f-ii) 


y 


■( + D) 


y 


(”D) 


4 y 


Let ip — 0. The equation Ay = 0 can be solved with respect to y: 

y= \ fy (+ll) + j/ (_ll) + y (+l2) + y ( ” l2) ] ■ 


The value of y at the center of the pattern is the arithmetic mean of the 
values of y at the remaining four nodes of the pattern. This formula gives a 
difference analog of the formula for the mean value of a harmonic function. 
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It is easily seen from (19) and (20) that no values of /.t(x) at the vertices 
of the rectangle appear in this matter. This feature has some influence on a 
proper choice of j ll . For the third boundary-value problem and the scheme 
of accuracy 0(\h\ 4 ) (see Section 5) the boundary j h consists of all the 
nodes on the boundary of the rectangle including its vertices. 

To evaluate the accuracy of the difference scheme (19)—(20), we pass 
to the difference z = y — u, where y is a solution of problem (19)—(20) and 
u is a solution of problem ( 1 '). Substituting y = z + u into ( 1 ') we set up 
the problem for the error 2 


(21) Az = -ip, xeui h , z = 0, 1671 , 

where ip = Am + / is the error of approximation of equation (1') by scheme 
(19). Since Lu + / = 0, we have 

ip = Am + / — Lu + Lu = Am — Lu , 


yielding ip = Am — Lu. From (8) it follows that 

for m 6 C (4) 


, < 9 4 m 

* = 12 « 


<T*m 
12 dx 4 


where the symbol over-bar designates that the values of the arguments are 
taken at some intermediate points of the intervals (aq —h i , aq), (aq +/q , x 2 ) 
and (aq , aq — h 2 ), (aq , aq + h 2 ), respectively. 

Q 4 M 

Within the notation M 4 = max ——- , we get 

a ,a Oxz 


xp | < M 4 


[hi 

12 


The proof of convergence of scheme (19) reduces to the estimation 
of a solution of problem (21) in terms of the approximation error. In the 
sequel we obtain such estimates using the maximum principle for domains 
of arbitrary shape and dimension. In an attempt to fill that gap, a non- 
equidistant grid 


(a.f 0, x^)), i a = 0, 1, . . . , N a , xl = 0, aW = l 0 


= 1 , 2 } 

with steps = xl ' 1 ^ and h 2 ^ — x }* 2 ^ can be introduced 

in the rectangle in the usual way for later use of the difference operator (13). 
Thus emerged instead of (19)—(20) the problem 


h 5 


(22) A y--f(x'), A y = y Sli:i + y S2 i 2 , 


x € u> 


y\ lh = K x ) ■ 
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This scheme provides the local approximation of order 1 since 
Vi = (Aw + f(x)) i = + u S2$2 + f{x)). 

= lE{ h( " +i) - h( a a) )^ + o(\nn 
- o(\h\), | hf^hl + hl 

However, by analogy with Chapter 3, Section 4, ?/q is representable by 

a-1 a 

From such reasoning it seems clear that scheme (22) provides an approxi¬ 
mation of second total order in the negative norm. 

4. The Dirichlet difference problem in a domain of rather complicated 
configuration. If a solution of the Dirichlet problem needs to be determined 
in a domain G with a nonlinear boundary, the grid hq(G) is, generally 
speaking, non-equidistant near the boundary. We describe below such a 
grid and give the possible classification of its nodes. 

Consider an arbitrary finite domain G with the boundary r in a p- 
dimensional space, where a point with coordinates aq , x 2 , . .. , x p is denoted 
by x = (aq , x 2 , ... ,x p ). We proceed to construct a grid in the domain 
G = G + T and confine ourselves, for the sake of simplicity, to the case of 
a two-dimensional domain (p = 2). Here a constructive supposition about 
the shape of the domain G is taken into account that the intersection of 
the domain G with any straight line passing through an inner point x G G 
in parallel to the coordinate axis Ox a (a = 1,2) consists only of a finite 
number of intervals. 

If the origin of coordinates is inside the domain G, we draw up two 
families of uniform-straight lines 

x(A) — h 1 , ij = 0, ±1, ±2,... , — C ^2 j *2 = 0j il, ±2 .. . , 

where h 1 > 0 and h 2 > 0 are fixed numbers. Such straight lines split up 
the plane (aq ,x 2 ) into rectangles of sides h 1 and h 2 . The vertices of these 
rectangles with coordinates aq = and x 2 = i 2 h 2 are called nodes and 
the set of all nodes is known as a grid in the plane (aq ,aq). The nodes 
aq = (i 1 h 1 , i 2 h 2 ) lying inside the domain G refer to inner nodes with the 
notation = {aq G G} for the set of all such nodes. The points of the 
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intersection of the straight lines x^G = i a h a , a = 1,2 with the boundary 
T of the domain G are called boundary nodes along the direction x a . 
We denote by j h a the set of all boundary nodes along the direction x a . 
Let 7/j = 7/j i + 7/j 2 be the set of all boundary nodes. It represents such 
nodes that are boundary at least with respect to one direction x a . The set 
of all inner and boundary nodes is known as a grid ui h = ui h + j h in the 
domain G (see Fig. 11). 



We offer below more a detailed classification of inner nodes. With this 
aim, let us draw up a straight line parallel to the axis Ox a through an inner- 
node x € oj h . Its intersection with the domain G is an interval (or several 
intervals), whose ends are boundary nodes along the direction Ox a . The 
nodes from this interval can be distinguished by the approved rules. We call 
the nearest to the end of the interval node a near-boundary node along 
the direction Ox a (with respect to x a ). If the distance to the boundary j h 
is h* y! h a , any such node is said to be irregular with respect to x a . Let 
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oj* h be the set of all near-bouudary nodes with respect, to x Q and ui* h * be 
the set of those near-boundary nodes, which are irregular in the direction 
x a . Obviously, oj^* a C w* a . The notation w* h stands for the set of all 
near-boundary nodes (that is, near-boundary at least in one direction) 
and u>^* stands for the set of all irregular nodes (that is, irregular at least 

in one of the directions x-, or x 2 ). Let 0 J h be the complement of u* h to ui h : 

co h = uj* h + 0 J h . All the nodes belonging to ui h are called strictly inner 
0 

nodes. The symbol u> h a is in common usage for all strictly inner nodes 

with respect to x Q (that is, the nodes adjacent to the node x € w ;i Q in the 
direction Ox a are inner ones). 

0 

In Fig. 11 the aforementioned nodes u> h are depicted by the signs o, 
the nodes being irregular only with respect to x a (a = 1,2) — by the signs 
k a , the nodes being irregular both with respect to x 1 and with respect to 
x 2 — by the signs 2 and, finally, near-boundary nodes regular both with 
respect to and with respect to x 2 — by the signs •. 

The grid Q h in view is supposed to be connected, it being understood 
that any two inner nodes can be joined by a polygonal line, the parts of 
which are parallel to the coordinate axes and vertices coincide with inner 
nodes of the grid. Then at least one of the four nodes x( ±a ), a = 1,2, of 
the five-point pattern (x^ 11 ), x, x^ 1 ^) (regular or irregular) falls within 
the collection of inner nodes. The assumption on connectedness of the grid 
entails some limitations both on the choice of spacings h 1 and h 2 and on 
the shape of the domain and its position with respect to the grid u> h for 
fixed /ij and h 2 . 

Examples of disconnected and connected grid domains are shown in 
Fig. 12.a and 12,b, respectively. The assumption on connectedness for a 
domain with a narrow bridge will be satisfied if we make the step h a small 
enough or refine the grid in this part of the domain. Fig. 12.b illustrates 
the case where the connectedness of the grid is stipulated by the proper 
choice of its step h i rather than by successive grid refinements. 

The procedure of constructing a grid in the plane domain we have 
described above can easily be generalized to the case of an arbitrary p- 
dimensional domain. A grid so constructed is a result of the intersection of 
hyperplanes (planes for p = 3 or straight lines for p — 2) 

xl a~ i a h a^ * a = 0,±l,..., tt=l,2,...,p, 

where h a > 0. The preceding classification of nodes remains unchanged 
here. 
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a) b) 

Figure 12. a) A disconnected grid, b) A connected grid. 


Our purpose here is to construct a difference scheme for solving the 
Dirichlet problem in the domain G = G + T, the complete posing of which 
is to find an unknown solution to the equation 


d 2 u 




dx’j 


d 2 u 

dxl 


f( x )> 


x = (xj ,x 2 )EG, 


which is continuous in the closed domain G = G + T and satisfies the 
boundary condition u\ = fi(x). 

At each of the inner nodes x £ u> h we approximate the difference 
operator 

r d 2 u 

aU ~&G 

by the three-point difference operator A a . 

If a node x £ u> h is regular with respect to x a , then the difference 
operator A a on the regular pattern (x( _1 “), x, is similar to (11): 


y (+b) _ 2y+ 

Aa y — Vx a x a — ^2 

cv 

But if a node x £ , that is, a node is irregular with respect to x a on 

the irregular pattern, then the difference operator A a can be rewritten as 


(23a) 


A*v = 


■/(+'“) 


y = ~r 

ha. 


y y-y ( ‘ 


for x( £ J h 
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where h* is the distance between the nodes x and ah 1q 4 or 

CV ’ 


(23b) 


Kv= k 


yi + ta) _ y 


y-y( h 


for x^ +1 “) £ j h i 


where h* is the distance between the nodes x and £^ +lQ h 

O' 

In this context, it is worth noting that the reader can encounter the 
case when ah -1 "-* £ and jh +la ) £ 7 ft a . If this happens, it is recom¬ 
mended to refer to the difference operator 


(23c) 


Kv = r„ 


y{ + 1 o,') _ y 


a + 


y-y ( la) 

hry — 


for £ j h 


where h* , ± h n is the distance between x and ah ±la ). 

Typical situations corresponding to the forms (23a)-(23c) for p = 2 are 
shown in Fig. 13. Using one of the formulae (11) and (23) for approximating 

o 2 

L a u — J)4r by the difference operator, we get instead of (1) the difference 

equation Ay + <p(x) — 0 for all x £ ui hl where A = A a . Here the 

exact value y | = pt(x) is taken on the grid boundary j h . 

Finally, we arrive at the Dirichlet difference problem of determin¬ 
ing a grid function y{x) defined for x £ Co h = u J h + 7;,,. satisfying at the 
inner nodes the equation 


(24) A y-\-tp(x) = 0 at the regular nodes, 

(25) A * y + <p(x) = 0 at the irregular nodes, 
and taking the assigned values at the boundary nodes x £ 7 ft : 

(26) y-p(x), * £ 7/i • 

By analogy with Section 3 we formulate conditions for the accuracy 
of a scheme under the agreement that y(x) is a solution of the difference 
problem (24)-(26) and u = u(x) is a solution of the original problem (1). 
Substitution of y — z + u into (24)-(26) yields 


(27) 


Az — —i/’ at the regular nodes, 

A” z = —'ip* at the irregular nodes, 


z = 0 °n 7/j , 
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where ip is the approximation error equal for tp(x) = f(x) to 
ip = Au + ip = A u — L u at the regular nodes, 

( 28 ) 

ip = A u — L u at the irregular nodes . 

Let u £ C( 4 )(G), where C is the class of functions u(x) with four 
continuous in G derivatives with respect to x 1 , . .. , x p . As stated in Sec¬ 
tion 3, we have at the regular nodes 

(29) I V 1 1 G M 4 lyrj - j \ h \ 2 = h 2 + h 2 + ■ ■ ■ + h 2 . 

Furthermore, in giving the approximation error at the irregular nodes as a 
sum 

(30) r = £ r a , </A = A a u-L a u, 

a= 1 

we apply the results obtained in Section 2 to the current situation: 

(31) »: = ££ -■ Id| + 0(fe,) = 0(1), VV = 0(1), 

meaning that at the irregular nodes the scheme does not approximate the 
equation Am + f(x) — 0. 

Thus, in the p-dimensional case a difference scheme such as 


Ay = £ A a y — —f(x) at the regular nodes, 

a = l 
P 

A*y = A* y = —f(x) at the irregular nodes, 

where A a y = y s x and A* is specified by the formula 

_ j/ y (+ M - y _ y - 

aV h a ^ h a + h a - J ’ 


is associated with problem (1). 
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Remark Quite often, the Dirichlet problem is approximated by the method 
based on the difference approximation at the near-boundary nodes of the 
Laplace operator on an irregular pattern, with the use of formulae (14) 
instead of (16) at the nodes x G u>* h . However, in some cases the difference 
operator so constructed does not possess several important properties in¬ 
trinsic to the initial differential equation, namely, the self-adjointness and 
the property of having fixed sign. For this reason iterative methods are 
of little use in studying grid equations and will be excluded from further 
consideration. 

5. The canonical form of a difference equation. We now consider the 
(2 p + l)-point scheme Ay = —/ at a regular node 

E (l/ (+1 “ ) -2y + y(- 1 “ ) ) = -/, 

a=l 7 « 

which admits an alternative form of writing 

( 32 ) E ^ y = ( 2/(+1 “ ) + y (_1 “ ) ) + /(*)• 

a=l a a=l “ 

To avoid cumbersome calculations, we concentrate primarily on the 
two-dimensional case. Fig. 6 demonstrates that at a regular node 


2 {^2 + ^2 j y ° ~ h 2 A + &) + Yi 2 + ^) + /o ■ 

Let i £ u* j be an irregular node. In the case corresponding to Fig. 13.a 
we obtain 


.* 1 ( Vi-Vo 2/o-2M = 1 (Vi y 3 2h i 

lVo h l v h, h* ) A, \h, h; A, h* 

where Aj = | (h 1 + A*), and 

a 2 y 0 = ( y 2 - 2 y 0 + j/ 4 ). 

From the equation A* y = A* y + A 2 y = —/ we find that 


Vo 


2/ij 

h l h * 


A 1 _ 1 
hi I Vo ~ ^ Vl 


1 1 

h 1 h* 2/3 + h'l 


{}h + Vi) + fo ■ 
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In the case corresponding to Fig. 13.c we deduce that 


2 


/ij h*_ h* + 


2 h 2 

h l K 


Vo = 


h 1 h 


Vi- 


1+ 


/ij h* 


2/s 


h 2 h* 2 


2/ 2 + ^2" 2/4 + /o > 


where ^ = |(/ij_ + h* 1 + ) and h 2 = L (/i 2 +/i*), 

Let u) h {G) be a grid in a p-dimensional domain and x G u>* h be a 
near-boundary irregular node. Then 


(33) 




1 /(+!“) 


2/ 2/ - y 


(-la) 


/l* 


i/( +1 <») 


„(-!») 


2 ft 


h n h* 


h n h* 


Substituting this expression into the equation A *y = —/ and regarding 
formally the node x to be irregular in all directions x a , we finally get 


(34) 


2 h n 


' h h* 

a=l " a- 


y( x ) = £ 


Of=l 


h °K+ 


1 a, ) 




h„h* 


f(x] 


K ~ 2 (^a+ + ^a-) ' 

This is acceptable for /i*_ = /i* + = tip — hp when x happens to be regular 
along some direction Xp. But if x is regular in all directions x a , then 
/i* + = h* a _ = 22 a ,= h a for all a = 1,2,... ,p, leading to formula (32). 
Comparison of (32) and (34) shows that these equations can be represented 
in the canonical form 

( 35 ) A(x)y(x)= Y B (x,Oy(0 + F ( x ), 

t;£Patt'(x) 

where Patt'(x) is the set consisting of 2 p nodes of the (2 p+ l)-point “cross” 
pattern with center at the point x except for the node x itself, that is, 
£ yf x. We call the set Patt(x)'(x ) the neighborhood of the node x. The 
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quantities A(x) and B(x,£) are the available coefficients of the equation. 
From (32) and (34) it is easily seen that 

(36) A{x) > 0 , B(x,£)>0, Yj B(x,£) = A(x) for all x 6 ui h . 

£ £Patt ! (x) 

Equation (35) is put together with the boundary condition 

(37) y\ lh = n(x). 

The Dirichlet difference problem is a special case of a more general 
problem in which it is required to find a grid function y{x) defined on the 
grid ui h = u> h + j h and satisfying on ui h the equation 


A{x)y(x)= Y B(x,Oy(Z) + F (x), 

(38) Patt'(x) 

y(x)=n(x), xEj h , 

where 

(39) A(x)>0, 5(x,O>0, D(x)=A(x)- Y > 0 

^tPatt 1 (x) 

for all x G uJ h , 

Remark The third difference boundary-value problem for Poisson’s equa¬ 
tion can always be represented in the form (38), equation (38) being satisfied 
for all x G ui h and conditions (39) being valid. Here, in addition, D > S > 0 
on 7 a ■ 

To prove the existence and uniqueness of a solution of problem (38)- 

(39), it suffices to check that the homogeneous equation 


(40) 


£[y\ = A(x)y(x) - Y B ( x >Z)y(0 = °> 
y{x) =0, x 6 j h , 


has only the trivial solution y{x) = 0 for x 6 u> h . We will show in the sequel 
that this fact follows immediately from the maximum principle, valid for 
schemes (38)—(39). 



258 


Difference Schemes for Elliptic Equations 


4.2 THE MAXIMUM PRINCIPLE 


1. The canonical form of a grid equation of common structure. The maxi¬ 
mum principle is suitable for the solution of difference elliptic and parabolic 
equations in the space C and is certainly true for grid equations of common 
■structure which will be investigated in this section. 

Let co be a finite set of nodes (a grid) in some bounded domain of 
the n-dimensional Euclidean space and let P £ co be a point of the grid co. 
Consider the equation 

( 1 ) A(P) y(P) = ^ B(P ! Q)y(Q) + F(P) > P e u,, 

QePatt'(P) 


related to a function y(P) defined on the grid co. Here the coefficients of 
the equation A(P) and B(P,Q ) and the right-hand side of the equation 
F(P ) are given grid functions; Patt'(P) C co, being the set of all the nodes 
of the grid co except for the node P, is the neighborhood of the node P. 
The pattern of the grid equation ( 1 ) at the node P consists, evidently, of 
the node P itself and its neighborhood Patt'(P). 

Similar equations do arise in grid approximations of integral equations. 
In what follows we will suppose that coefficients A{P) and B(P,Q) are 
subject to the conditions 


( 2 ) 


A(P)> 0, B(P,Q)> 0 

D(P)=A(P)~ 


for all P G co, Q 6 Patt'(P), 
E B(P,Q)>0. 

Q£Patt ! (P) 


A point P is called a boundary node of the grid co if at this point 
the value of the function y(P) is known in advance: 


(3) 


y(P) - y(P) for P 67 , 


where 7 is the set of all boundary nodes. 

Comparing (3) and (1) we see that on the boundary 7 we must set 
formally A(P) = 1, B(P, Q) = 0 and F(P) = y(P). 

We call the nodes, at which equation (1) is valid under conditions (2), 
inner nodes of the grid; u> is the set of all inner nodes and Co — uj + 7 
is the set of all grid nodes. The first boundary-value problem completely 
posed by conditions (1)—(3) plays a special role in the theory of equations 
(1). For instance, in the case of boundary conditions of the second or third 
kinds there are no boundary nodes for elliptic equations, that is, Co — 00 . 
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The grid ui is taken to be connected, that is, for fixed points P G ui 
and P G ui there always exists a sequence of neighborhoods {Patt' (P)} such 
that the passage from P to P can be done using only the nodes of those 
neighborhoods or, in other words, one can select nodes Pi , P 2 ,. .. , P m of 
the grid ui such that 

Pi G Patt'(P), P 2 G Patt’(Pi), . . . , P m G Patt'(P m - 1 ), P G Patt'(P m ) 
with 


B(Pi,Pi+i)^ 0, i = 1,2,... , m - 1, 

(4) , , - 

B(P,Pi)#0, B(P m ,P)^ 0. 

In the case of the difference scheme for the Dirichlet problem (24)-(26) of 
Section 1 the definition (4) of connectedness coincides with another defi¬ 
nition from Section 1. The very definition implies that the point P may 
be boundary and, hence, the connectedness is to be understood that every 
point of the boundary belongs to the neighborhood Patt'(P) of at least one 
inner node. 

Within the notation 

(5) £y(P) = A(P)y(P)~ £ B(P,Q)y(Q), 

QePatt'(P) 

we may attempt equation (1) in the form 

(6) Cy(P) = F(P). 

An alternative form of £ y(P ) may be useful in the further development: 

( 7 ) £y{P) = D(p) y (p)+ J2 Q) (y( p ) - viQ)) ■ 

QePatt'(P) 

In the preceding section the Dirichlet difference problem was set up 
in the form (1), (3). Consider as one possible example the so-called scheme 
with weights for the heat conduction equation 

du d 2 u 

= q^2 +/(M), 0 < x < 1, f>0, 

u(x, 0) = u 0 (x), u(0 t t) = n 1 (t), — n 2 (t) ■ 
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On the grid ui hT = {(x,- = ih, tj = jr), i = 0, 1, .. N, hN = 1, j = 0,1,...} 
this scheme takes the form 


( 8 ) 


,j+i 


A y = Vsx 


= A {cryl +1 + (1 - cr)yi) 

= u o (**)> 


+ H . 

2/AT = /Li(*,') • 


These difference equations are convenient to be presented in the canon¬ 
ical form (1), giving P as a node of the grid ui hT \ P = P(x i ,t J - +1 ), 
where Patt'(P) consists of the nodes Q j = (x,,^), Q 2 = ( x i-i itj+i)> 
Q '3 = (a ,’ i+1 Qa = ,2j), Qs = (x i+J ,fj) and the boundary 7 

consists of the nodes (x, , 0) and (0, tj), (1 ,tj), i = 0,1,.. . , N, j = 0, 1,. ... 
Next, we fix some moment t = f - +1 and rewrite ( 8 ) as 


2 <7 
~h? 


y ! +1 = p(y/L + 1 1 +y/+ + i 1 ' 


I + 2(0- -1) 

T 

1 — a 


h 2 


/> 2 


(»/-i 




From here it is easily seen that B(P , Q) > 0 only if r < /i 2 /2(1 — < 7 ) and 
0 < u < 1. By the same token, .D(-P) = 0. 

2. The maximum principle. 


Theorem 1 (the maximum principle) Let y(P) ^ const be a grid function 
defined on a connected grid ui and let both conditions (2) and (4) hold. 
Then the condition Cy{P) < 0 (C y{P) > 0) on the grid u> implies that 
y(P) cannot attain the maximal positive (minimal negative) value at the 
inner nodes P G ui. 


Proof Let Cy(P) < 0 at all of the inner nodes P G u>. On the contrary, 
let y(P) attain its maximal positive value at an inner node P Gw, so that 

y(P) = max y{P) = Mq > 0. 


The theorem will be proved if we succeed in showing that there exists an 
inner point P at which Cy(P) > 0, violating the condition Cy(P) < 0. 
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Since y(P) > y(Q ) for all Q £ Patt'(P), we find by virtue of the relations 
D(P) > 0 and y{P) > 0 that 

£y(P) = D(P)y(P) + ]T B(P,Q)(y(P)-y(Q)) >D(P)y(P)>0. 

Q£Patt'(P) 

From such reasoning it seems clear that only the case £ y(P ) = 0 
needs investigation. As formula (7) shows, it is possible only if D(P) = 0 
and y(Q) = y(P) for all Q £ Patt'(P). 

We now take the node Pi £ Patt'(P) at which y{P\) = y(P) = Mo 
and adopt those ideas. Since y(P) p const on the grid lo and the grid is 
connected, there exists a sequence of nodes Pi , _P 2 ,. . . , P m , P, satisfying 
conditions (4), such that 

y(P m ) = y(P) = Mo , y(P)<M 0 , 


but 

P £ PaU'(P m ) . 


Then 


£y(P m ) > D(P m ) y(P m ) + B(p m ,P) {y(P m )~y(P)) 

> B(P m , P) (y(P)-y(P))> 0, 

meaning P = P m and justifying the first assertion of the theorem. The 
second assertion will be reduced to the first one once we replace y(P) by 

~y(P)- 


Corollary 1 Let conditions (2) and (4) hold and let a grid function y(P) 
defined on u> + 7 be nonnegative on the boundary, that is, y(P) > 0 for 
P £ 7 and £ y(P) > 0 on u>. Then y(P) is nonnegative on cu + y, that is, 
y(P) > 0 for all P £ us + y. But if y{P) < 0 on y and £y{P) < 0 on ui, 
then y(P) <0 01101 + 7 . 

Proof Let £ y(P) >0ono and y(P) > 0 on 7 , Suppose that y(Po) < 0 at 
least at one inner node Po G w. Then y(P) should take its minimal negative 
value inside the grid lo, what is impossible on account of Theorem 1, since 
y(P) p const on the grid ui{y(Po) < 0, y | 7 > 0). The second assertion of 
the theorem can be proved in a similar manner. 
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Corollary 2 The homogeneous equation (1) subject to the boundary con¬ 
dition 


(9) £y(P) = 0 on ui, y(P) = 0 on 7 , 

has only the trivial solution y(P) = 0. 

It is straightforward to verify that y(P) = 0 is a solution of problem 

(9) . Further, assume to the contrary that there exists a solution y(P) ^ 0 
of problem (9). If y(P) yl 0 at least at one point, then by Corollary 1 the 
inequalities y(P) < 0 and y(P) > 0 must hold simultaneously. But it is 
possible only if y(P) = 0. Thus, we have proved the following assertion. 

Corollary 3 Problem (l)-(4) possesses a unique solution. 

3. Comparison theorem. The majorant. 

Theorem 2 Let y(P) be a solution of problem (l)-(4) and let Y (P) be a 
solution of the problem 

(10) CY(P) = F(P), PEui, Y(P) = p(P), P 67 . 

Then the conditions 

(11) \F(P)\<F(P), PElo, \p(P) | < p(P), P e 7) 

provide the validity of the inequality 

( 12 ) \y{P)\<Y{P) for P Gw+ 7 . 

Proof By Corollary 1 the inequality Y(P) > 0 is valid on u> + 7 . The 
functions u(P) = Y(P) + y(P) and v(P ) = Y(P) — y{P) solve the equations 
jCu=.F u = F-\-F> 0 and £v=F v = F—F> 0 subject to the boundary 
conditions u | 7 = (Y + t /)| 7 =// + //> 0 and u | 7 = (Y — j/)| = p — p > 0. 

Since the conditions of Corollary 1 are satisfied, we have u > 0 or 
y > — Y, v > 0 or y < Y. It follows from the foregoing that — Y < y < Y 
or | y{P) | < Y (P) on us + 7 . 

The function Y (P) is called the majorant for a solution of problem 
(l)-(3). Its determination entails immediately the validity of the desired 
estimate for || y || c . 
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Corollary For a solution of the problem 

(13) £y = 0 on lj, y(P) = p(P) on 7 , 
the estimate 

( 14 ) max | y(P) | = || y\\ c < |M| C 

is valid with || p || c = maxp 67 | p(P) |. 

Indeed, let us specify the majorant Y (P) by the conditions CY = 0 

on u> and Y = ||/i||„ on 7 . The function Y(P) is nonnegative on u> + 7 

y y 

and attains its maximum at some node of the grid. This node is none the 
inner nodes if Y(P) yt const and, hence, 

II Y |U = max Y(P) = max Y(P) = || p |L . 

-Pew+7 Pe-y c y 

If y (P) = const, then Y ( P ) = || p || c . In both cases || Y ||^ = || p || c . 
Combination of this relation and the inequality H 1 /II 7 < ||Y ||^ gives esti¬ 
mate (14). 

4. The estimate of a solution to the nonhomogeneous equation. In the 

further development a solution of problem (l)-(3) is viewed as a sum 


y-y + v, 


where y = y(P ) is a solution to the homogeneous equation 

(15) Cy = 0 on w, y = p(P) on 7 , 
and v = v(P) is a solution to the nonhomogeneous equation 

(16) Cv{P) = F(P) on ui, v(P) = 0 on 7 . 

We have already obtained estimate (14) for y(P ) and so it remains to 
evaluate the function v(P), 

Theorem 3 If D(P) > 0 everywhere on the grid u>, then a solution of 
problem (16) admits the estimate 

F 

D 


(17) 


Ml c < 


C 
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Proof Let a majorant Y(P) be taken such that 

CY=\F(P)\, Y| 7 = 0, Y(P)> 0 for Peu+y 

and Y (P) attain its maximum at a node Po 6 ui. As far as Y (Po) = || Y || c 
is concerned, the equation 

D(P 0 )Y(P 0 )+ B(Po,Q){Y(P 0 )-Y(Q)) = | P(P 0 ) | 

QePatt'(Po) 

yields 

D(P 0 ) Y(P 0 ) < | F(P 0 ) |, Y(P 0 ) < < | ~ || c , 

thereby completing the proof. 

Remark Estimate (17) is still valid for the solution of problem (16) pro¬ 
vided that instead of (2) other conditions 

\A(P)\^Q, |B(P,Q)|#0, 

D(P) = I A(P) | - | B(P , Q) | > 0 

Q^Patt'{P) 

hold. 

Indeed, let | v(P) \ > 0 take the maximal value at a node Po- Because 
of this fact, 

|A(P 0 )| • \v(P 0 )\= | ^ B(P 0 ,Q)v(Q) + F(P 0 ) 

QePatt'(Po) 

< E \B(P 0 ,Q)\ ■ \v(P 0 )\ + \F(P 0 )\, 

QePatt'(Po) 

whence it follows that 

D(P 0 ) | v(P 0 ) | < | F(P 0 ) | , || HIc = I v(Po) I < < | ~ || c ■ 

It may happen that D(P) = 0 on a subset ui of the grid u> and D(P) > 0 
0 0 

on the complement of i o to uj: uj +c u* = uj. This type of situation is covered 
by the following assertion. 
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Theorem 4 Let the conditions 

D(P) = 0 for P Ew, D(P) > 0 for P 6 w* 

hold, where ui is a connected grid. Then for a, solution of problem (16) with 
the right-hand side 

F(P) = 0 for P Eu, P(P)^0 for 


the estimate 
(18) 


IMI C < 


A 

D 


c* 


is valid in the norm || / || c . = maxp 6w . | f(P) |. 


Proof Let Y(P) be a majorant and £ Y = \ F(P) | on the grid ui, Y| 7 = 0, 
y > 0. The function Y(P) should attain its maximum on a finite set u> + j 

at some node, not belonging to the boundary, because Y | = 0. Also, it 

0 ° 

does not enter the grid i o due to the connectedness of uj and the maximum 
principle. Hence, 


max Y(P) = max Y(P) = Y(P 0 ) , 

P£lO P£lO* 

where Po is a node on the set u>*. 

By the initial hypothesis, D(Po) > 0. Arguing as in the proof of 
Theorem 3 we arrive at (18). An analog of the remark to Theorem 3 is still 
valid for that case. 


4.3 STABILITY AND CONVERGENCE OF THE DIRICHLET 
DIFFERENCE PROBLEM 

1. Estimation of a solution of the Dirichlet difference problem. We make 
use of a priori estimates obtained in Section 2 for a grid equation of common 
structure for constructing a uniform estimate of a solution of the Dirichlet 
difference problem (24)-(26) arising in Section 1: 

A y = —ip at the regular nodes, 

(1) A *y = —ip at the irregular nodes, 

y = p(x) on the boundary, 
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where 

v 

A y = Y Aay ’ A ° y = 1 

a = l 

a *y = Y A *y> 

a= 1 

1 ( j/ (+1 “ ) — y y-y { ~ la) 

Ao y = r- -r-r- 

n a y h a + h„- 

Other ideas are connected with the operator A, which coincides with A* at 
the near-boundary nodes and with A at the remaining inner nodes, leading 
to an alternative form of writing 

(2) A y=-ip, x£u) h , y\ jh =y(x). 

In conformity with Section 1, problem (1) can be recast as 

(3) A(x) y(x) - Y B(x,0v(0 + F(x), x E ui, y\^ = y(x) , 

£ £Patt ! (x) 

where 

A(x) > 0, B(x,£) > 0, D(x)=A(x)~ Y B ( x >0> 0- 

£ tPatt'^x) 

We now represent a solution of problem (1) as a sum 

y = y + y, 

where y and y are,'respectively, solutions of the appropriate problems 


(4) 

O 

I! 

iC 

y = y for 

x £ 7/j 

(5) 

A y = -<p, 

y = 0 for 

x £ 7 h 


An estimate for a solution of problem (4) such as 

(6) ll2/Hc<IMU 
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has been derived in Section 2 and may be useful in such a setting. 

Having decomposed the right-hand side ip as 

ip = tp + tp*, 

0 , 0 
where ip = ip and ip* = 0 at the strictly inner nodes x G i o h (see Section 1) 

o 

and ip = 0 and ip* = ip at the near-boundary nodes x G ui*, we agree to 
consider 

y = v + w 

with v and w being solutions of the problems 


(7) 

( 8 ) 


Av = 
A w = 


- <P 
* 

-p 


for x G u> 


h > 


o, 


for x G u h , 


w\ = 0. 

[ lh 


We are going to evaluate separately each of the functions v(x) and 
w(x). In order to estimate v(x), it is necessary to construct a majorant 
Y(x). Assuming that the origin is inside the domain G, we try to determine 
a majorant of the type 


Y(x) = K (R 2 — r 2 ), 


E E 

a=l 


where K > 0 is a constant and R is the radius of a p-dimensional ball (a 
circle for p = 2) with center at the origin containing entirely the domain 
G. The constant K will be chosen a little later. 

By virtue of the relations A„ = 0 for a yt [3 and 


A a x; = 


(Tc + E) 2 -Ixl + ixg- h c 

h 2 


= 2 , 


A* x 2 ~ — 


(x a T h-a+ / 


h n -' 


h n - 


m+ 


+ h a - 


2 h„ 


we find that 


AY = ^ A a Y = —2pK 

Q=1 

A*Y = —2p9K 


for x G u> h , 


h > 


for x E u) 
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P 

where 6 = p~ l J2 9 a - Here 9 a = 1 if a node x G u>* is regular along the 

a= 1 

direction x a . Thus, Y is a solution of the problem 

A Y = -F(x), Y\ ih = K (R 2 - r 2 )\ ih > 0, 

where F(x) = 2pK for x £u> h and F(x) = 2 p9 K for x G w*. 

0 

Comparison with problem (7), where F = <f >, that is, F = 0 for 

0 

x G ui* h and =0, shows that F(x) > \ F(x) \ = \ <p(x) | if we accept 

K = T-|| <P || c . Here the conditions of the comparison theorem in Section 
2 are valid as long as F(x) > | F(x) | = 0 for x Gw*, assuring the relation 

IMI C < Illic¬ 
it is easily seen from the expression for Y that || Y |( c < KB?. So, for 
a solution of problem (7) the estimate 


(9) 


& 

Ip 


l«M c < 27M ^ 


R 2 

2 ~P 


c 


is valid in the next norm || tp || o = max^^. | <p(x) |. 

Our next step is the estimation of the function w(x). First, we are 
going to show that for problem (8) 

(10) D(x) > , where h = max h a , x G ui* h , 

(11) D(x) = 0 for x G u h ■ 


Assertion (11) is simple to follow. 

After that, wp look at equation (8) at a near-boundary node x G w* 


( 12 ) 


A(x)w(x)= Y B (x,t)w(t) + F(x), 

^ePatt'(x) 

F(x) = p*(x ), ™| 7 h =0. 


If one of the nodes £ = £ 0 , say ? 0 = x^ +lo: \ happens to be a boundary 
node, then w(£ 0 ) = 0 and the neighborhood Patt'(x) contains no point £ 0 . 
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In this case the function D{x) takes on the value 
D(x) = A(x)- ^2 B (x,0 

£E_P aii' (.r) 

= A( a; )- J2 B(x,t)-B(x,t 0 ) 

-££Patt ! (cc) 

= B(x,Q , 

since A{x) = P B(x,£) for the Laplace equation. This provides 

l;£Patt'(x) 

support for the view that 

D(x) = B(x, £ ( - +1 “)) > 0. 

If a node x is near-boundary not only with respect to x a! but also in 
other directions, then sum (12) contains no other terms for £ = £j,£ 2 , • •• i£k> 
so that 

D{x) = 5(x,£ 0 ) + B(x,£ j) + ■ ■ • + B(x,£ k ) > 0 . 

Let x G ui* t be a near-boundary and irregular node only in some di¬ 
rection x a and £ 0 = G j h , x^~ la ' ) G u> h . From the equation 
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we establish the relations 


A(x) 


1 

h a h Q + 


" P=L 13 
Pita 


D B ^-o=w 

tePattpx) a 


+ E 

P = L 

Pita 



h a h a+ h 2 

If x is a regular near-boundary node only with respect to x a , then 

a 

When, in addition, it turns out to be near-boundary in other directions, 
the function D(x) can only increase. Just for this reason estimate (10) 
continues to hold on the same footing. 

To evaluate a solution of problem (8), we apply Theorem 4 of Section 
2 due to which 


(13) 


HIc < 


D 


< h A 


\f 


Collecting estimates (6), (9), (13) and then involving the well-known in¬ 
equality || y ||^ < || y ||^ + || v \\ c + || w H^, we establish the following theo¬ 
rem. 


Theorem 1 For a solution of the Dirichlet difference problem the estimate 

( 14 ) II v lie < II y llc T + II f II + h ' 2 Wf lie* 

holds with 


max | f(x) | , 
x ^h+ih 

11/11° : 

= max 

1 /(*) 

- max | f(x) | , 
xeuj h 

II/Ik 

— max 

1 /(*) 


This theorem expresses the stability of the Dirichlet difference problem 
(1) with respect to the boundary data and the right-hand side. 
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2. The uniform convergence and the order of accuracy of a difference 
scheme. In the study of convergence and accuracy of scheme (2) we begin 
by placing the problem for the error 

z = y-u, 

where y is a solution of problem (1) and u = u{x) is a solution of problem 
(1) arising from Section 1. Substituting y = z + u into (1) or (2) yields 

(15) A z =—ip(x), x £ us, z| 7 = 0, 

where t/s(x) = A u + <p(x) is the residual. 

We stated in Section 1 that 


iP(x) = 0(\h\ 2 ) = 0(h 2 ) 
^(x) = 0(1) 
or, more specifically, 

MAh\ 2 


I ib I < 

12 

\ip | < p m 2 


/ M 4 >2 

~ ^ 77 


at the regular nodes, 
at the irregular nodes, 

at the regular nodes, 
at the irregular nodes, 


/her 


Mk = max 

xtG 

l<a<p 


d k u 

dx k 


, At = 2,3,4,. 


E h 2 , h = max h„. 

a ’ l< a<p a 

a = l ~ ~ 


Also, Theorem 1 of Section 1 asserts that estimate (14) is of the form 

„ „ R 2 „ , „ 7 2„ „ 

IMIc ^ ^ + h II^Hc* • 

Using the estimates of | ip | obtained above we arrive at the relation 


(16) 


Rr 

y~ u \\ c < I ~2a Ma + pM2 ^ h 


making it possible to formulate the following statement. 

Theorem 2 If u(x) £ C A (G), that is, a solution possesses continuous 
derivatives in G = G + T of the first four orders, then the difference scheme 
converges uniformly with the rate 0(h 2 ), that is, it is of second-order ac¬ 
curacy, so that estimate (16) is valid. 
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4.4 SOME PROPERTIES OF DIFFERENCE ELLIPTIC OPERATORS 

In this section we reveal some properties of difference operators approxi¬ 
mating the Laplace operator in a rectangle and derive several estimates for 
difference approximations to elliptic second-order operators with variable 
coefficients and mixed derivatives. 

1. Eigenvalue problems for the Laplace difference operator in a rectan¬ 
gle. Let Go = {0 < x a < l a , a = 1,2} be a rectangle, ui h = {x = 
(ij h 1 , i 2 h 2 ), i a = 0,1,2,. .. , N a , N a h a = l a } be a grid in Go and j h be 
the set of all boundary grid nodes. The grid u> h is taken to be equidistant 
in each direction x a with step h a . 

The eigenvalue problem for the Laplace operator in the rectangle Go 
subject to the first kind boundary conditions 


Au+Au = 0, x £ Go, u| r = 0, 
has an infinite set of the eigenvalues such as 


■>{x) ji 0, 


A, = A 


k\k2 


a! 


l ± 

i i. 


1 , 2 ,... 


a= 1,2, 


associated with the orthonormal system of eigenfunctions 


v k,k 2 {x) = 


4 . 7 rk. , 7rk 2 

—— sin —— x, sin —— x 0 , 

h h h k 


so that 


where 


v k,k 2 . v k[k' 2 ) = 6 k2 k> 2 , 

h h 


/ dx j / dx 2 u{x 1 ,x 2 )v(x lt x 2 


0 0 


This problem can be solved by the method of separation of variables. The 
eigenvalue problem for the difference Laplace operator Ay = y llXl + y X2X2 
supplied by the first kind boundary conditions may be set up in a quite 
similar manner as follows: it is required to find the values of the parameter 
A (eigenvalues) associated with nontrivial solutions of the homogeneous 
equation subject to the homogeneous boundary conditions 


h ’ 


(i) 


Ay + Xv = 0 


x G ui 


G 7(i =°, v(x) ^ 0 . 
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Observe that j h and, hence, Co h contain no nodes (0,0), (0,At 2 ), (AC ,0), 
(N\ , N'j) being the vertices of the rectangle. 

We seek a solution of problem (1) by the method of separation of 
variables as a product 

v(x 1 , x 2 ) = /i(aq) i](x 2 ), x l = q h j , x 2 = i 2 h 0 , 
Substitution of this expression into the equation 

A v + A v = v Si Xi + v S2 X2 + Xv = 0 


yields 


( 2 ) ^(ahj + M-C) >k 2 :,; 2 (^2 ) + A^xJj^aq) = 0. 

Because we are interested only in nontrivial solutions of problem (1), the 
division of both sides of equation (2) by yu(aq) i]{x 2 ) yt 0 is meaningful. As 
a final result we get p Si Xl /n + i] X2X2 /i] + A = 0 or 


(3) 


AC, X\ 

A 


h^x 2 _ X = -AW 


with A*- 1 ) = const being independent neither of x i nor of x 2 . In view of 
this, we might set up for /i(xj) the eigenvalue problem on the grid 

= {ah = h hi > h = 0, 1, • • • , AC; h 1 AC = C} , 


the statement of which is 


Ai /i + AW/i _ p. Si . Ci + X 1 - 1 )/! _ 0 , 

X ^ h — 1,2,... , -/V} 1 , fig — 0, f-l yy, — 0 . 


The conditions = /x N =0 follow immediately from the relations 
/x(0)r](x 2 ) = 0, f/(/j)ry(x 2 ) = 0 and r/(x 2 ) ^ 0. As we learn from Chap¬ 
ter 2, Section 3, a solution of this problem acquires the form 


(i) _ 

k 


4 

hf 


• 0 
sin" 5 


7T fcj /lj 

2/j 


2 . 7T k. X, 

— sin - 

ij ij 




k = 1,2,... ,AC - 1 
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where {y kl (x 1 )} is an orthonormal system of eigenfunctions: (y kl ,//j./) = 
S kl j./ under the inner product structure (y, v) 1 = y(i 1 h 1 ) v(i 1 h 1 ) h 1 . 

From the governing relations (3) a similar problem arises for y(x 2 ) 
with A( 2 ) = A — AW; 

t) s x + X^rj(x 2 ) — 0 , x 2 = i 2 h 2 , i 2 = 1,2,... , N- 2 — 1, 
ho = 0, Vn 2 - 0 , 

whose solution is given by 


A (2) - sin 2 


7r k 2 h 2 


Vk 2 (* 


2 l 2 

k 2 = 1,2,... ,N 2 


— sm 
2 


7T & 2 X 2 


1 . 


Here (r) k2 , y k >J 2 = <5^, where (y, u) 2 = Y^ 2 =i y(h h 2 )v(i 2 h 2 )h 2 . Thus, 
problem (1) is completely solved, meaning that to the eigenvalues 


A k — ^k,k 2 


= a1! } + 


a ! 2) 

k 2 


or 


( 4 ) 


^k\k2 


hi 


7r h 1 

2/j 


7T h 2 


K 


2 L 


k, = 1,2, 1, £ 2 = 1, 2,... , iV 2 - 1 , 

there correspond the eigenfunctions 

(5) v k (x) = ,x 2 ) = ^(xj/i k2 (x 2 ) 


I 4 , 7T k, X, . 

j~y sm —--sm 

l l l 2 (j 


k, = 1,2,... ,N 1 - 1, 


7T X 2 


k 2 = 1,2,... ,iV 2 - 1. 


The total number of the eigenfunctions is equal to (tVj — l)(iV 2 — 1) = iV. 
These constitute an orthonormal system 


v k j k 2 i v k' k' 


*ki ki ®k-2 kL 


( 6 ) 
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in the sense of the inner product 
JVi-i JV 2 -l 

(7) (y,v)= X X y(h h i ’ i 2 h 2 )v{i 1 h 1 ,i 2 h 2 )h 1 h 2 

Z2=l = t 

= X y( x ) v ( x ) h 1 h 2 • 

x£u h 

Therefore, any function f(x 1 , x 2 ) defined on the grid ui h and vanishing on its 
boundary can always be expanded on the system of functions {v k k (x 1 ,x 2 )}: 

f( x ) = E c k v k {x), c k = (f,v k ). 

k = 1 

In the case of the second boundary-value problem with dv/dn\ = 0, 
the boundary condition of second-order approximation is imposed on j h as a 
first preliminary step. It is not difficult to verify directly that the difference 
eigenvalue problem of second-order approximation with the second kind 
boundary conditions is completely posed by 


A r> + Ar> = 0 , x£u> h> A v = Aj v + A 2 v , 


^ > x a 0 » 


A-a V — < V Xa , 


ha — x a — la ^a ’ 


[, h ’ Xa ^ a> a ^ ^ ' 

Indeed, assuming that u(x) is a solution to the equation A 11 + Am = 0 
subject to the condition du/dn | = 0, the error of approximation for the 

boundary condition is represented by 

v~ = (u Xi + \ h l A 2 u + \ h 1 A u) | 


du h 1 d 2 u h 1 d 2 u h^u 

dx 1 2 dx 2 2 dx' 2 2 


0(h 2 ) 


+-A- (Au + A m) + 0(h 2 ) - 0(h 2 ). 

UX 1 £i-0 z ® 1= o 
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In a similar way we find that 

v t =(-%! + \h 1 k 2 u+ | h 1 \u)\ =0{h\), 

Xi—h 

etc. By means of the method of separation of variables problem (8) reduces 
to the two one-dimensional eigenvalue problems for /i( x j) = /.i(ij /ij) and 
rj(x 2 ) = r)(i 2 h 2 )\ 


+ A(1 V = 0, 

(Vx! + 2 h l A0 V) 

=0, 


( — /fisq + 2 ^1 A(1 V) 

#1 = 

c 0; 

+ A(2)r ?= 0 > 

£2 = 0 

=0, 


(-%2 + I h 2 X ( 2 ) v ) I 

= 0 . 


Their solutions have been already found in Chapter 2, Section 3. 

Along these lines, we can immediately write down the eigenvalues and 
the orthonormal eigenfunctions 

( 9 ) A k - k 2 - + ^k 2 > 

(!0) v k (x) = v kiki (x 1 ,x 2 ) = n^x^ri^xj , 

k a = 0,1,2,... ,N a , cr = 1,2, 

where 


= Al 2 ) = 0. 


( 11 ) 


Ai“> = 


4 

h? 


sin 


7r k a h c 

2L 


1 < k a < N a , 


a = 1,2; 
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and 


(1^) k 2 ’ V k[ k 2 \ ‘E k[ ^k 2 k 2 

with 

(14) [y, v] = ( y, v) + [y( 0, 0) u(0, 0) + y( 0, l 2 ) u(0, l 2 ) 

+ 2/(4 > 0) v (h ) 0) + 2/(4 , 4) v (h > 4)] 

h N2 ~ 1 

-)- 2 ^ ' [ 2/(0 > 4 E) ^(0) 4 E) 

i 2 =2 

+ t/(lVi /ij , i 2 /i 2 ) v(N[ h 1 ,4 * 2 )] E 

/i 7Vl ~ 1 

+ E J2 b(4 >°M4 . 0 ) 

*!=2 

+ j/(i x /ij , N 2 h 2 ) v(i l h i , N 2 h 2 )\ h 1 , 
the inner product (y, v ) being understood in the sense of (7). 

0 

2. Properties of difference operators. Introduce the space Qh of all grid 
functions defined on the grid uj h = ui h +j h and vanishing on the boundary 
j h and the space fi/j comprising all the functions defined on uj h . The inner 
product in the space fi/j is defined to be 

(V,v)= E y(x)v(x)h 1 h 2 . 


( 15 ) 
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We list below the properties of the difference Laplace operator acting from 
0 0 

Qh into Q, h C fifc. By definition, 

At = Ai v + A 2 v, A a v = v SaXa , a =1,2. 

1. The operator A is self-adjoint: 

0 

(16) (Ay, v) = (y, Av) for all y, v 6 . 

To make sure of it, it is straightforward to verify the chain of the relations 
N 2 -l Ni-l 

( A i y,v)= h 2 h i( vA iy)iii 2 

i 2 = l l = 1 

N 2 -l Ni — 1 

= X! ^ E (y = ( 2 /. A i v) 

i 2 = l ij—1 

with a simple observation that the operator Ai is self-adjoint on the grid 
~ i x i - h h i > *i = 0,1, ■ ■ • , All , 

This is due to the fact that the order of summation over ij and i 2 may be 
interchanged. In a similar way we obtain 

(A 2 y,v) = (y, A 2 v) , 

which leads to (16). 

2. The operator —A is positive definite: 

(17) (-A y, y) >6 II y II 2 , 


, 4 . 2 7 rh 1 4 . 2 

6 =kf sm 217 + 7;j sm 


7 t h 2 8 8 

Ji;-q + p 2 = 0 


This property follows immediately from the relation 


A min II y II 2 < ( ~ A v,y ). 


which is certainly true with 6 = A mm (see Section 1). 
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3. The operator A admits the bilateral estimate 

(18) 6 II 2 / II 2 < (~ A y,y) < A || y || 2 , 

where 6 is the same as before and 

4 0 7r h, 4 „ 7 t h 0 4 4 


A = A„ 


9 7T h, 4 9 7 t h 0 

kf cos 7i7 + i| cos -Jk < T; + rr A ‘- 


From the relations just established and the lower estimate for 6 we deduce 
that 


( 19 ) K \\y\\ 2 < (~ A y,y) < a 0 |M| 2 . 

These properties provide support for the view that the operator A = —A 

is more convenient for many things than the operator A. The operator A 

0 

can be treated as an operator either from Hh = Qh into C Hh or from 
Hi j = fi/j into Hh by merely setting 


Ay = - Ay , y £ , 

~ 0 

where Ay = Ay for y G Qh- In accordance with what has been said above, 
we have in the space Q,h 

A = A*, 6 E < A < A E 

with E denoting the identity operator. 

0 

Any function f E Qh, defined on the grid u> h and vanishing on the 
boundary j h or defined only on ui h) can be expanded into a series of the 
eigenfunctions of the operator A: 

N 

' /M = E c k v k, c k = ( f,v k ), 

k~ 1 

so that l N Cj = || /1| 2 , where v k are the eigenvectors of the operator 

A: Av k = X k v k ,N = (N 1 -l)(N 2 -l). 

In the case of the second eigenvalue boundary-value problem (8) the 
space Hh = comprises all the functions defined on the grid ui h ] the inner 
product (,) on Hh is to be understood in the sense (14) and the operator 
A is defined as a sum 

A = A\ + A 2 , 
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where 

A a ij= -A a y = -y Xa Xq for 0 < x a = i a h a < l a , 

A a y =-A~y =-2y Xa /h a for x a = 0 , 

A a y = -A+t/ = 2y ga /h a for x a = N a h a = l a , a =1,2. 

With this in mind, problem (8) is convenient to be taken in the operator 
form A y = A y. The operator A so defined is self-adjoint and nonnegative: 

0 < A < A E, A = A*, 

where A = A max = 4(fi^ 2 + h~ 2 ). 

Observe that the operators Ai and A 2 are commuting and self-adjoint 
both for the first and second boundary-value problems. The methodology of 
the general theory (see Chapter 2, Section 1) guides the choice of a common 
system of eigenfunctions coinciding with the system of eigenfunctions for 
the operator A = Ai + A^ \ in so doing, each eigenvalue of the operator A is 
equal to a sum of the appropriate eigenvalues of the operators A t and A 2 '. 

A(A) = A(Ai) + X(A 2 ). 

3. The Laplace operator in a domain consisting of rectangles. We now 

consider a domain consisting of a finite number of rectangles, whose sides 
are parallel to the coordinate axes as shown in Fig. 14. 



Figure 14. 
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The sides of rectangles, which constitute the domain G are assumed to 
be commensurable. All this enables us to place in the plane a grid with steps 
and h 2 so that the boundary of the grid domain lies on the boundary of 
the domain G. One trick we have encountered is to complete the domain 
G to the rectangle and then denote it by G (see Fig. 14). After that, we 
construct in G a difference grid ui h and extend it to G. The notation ui h 
will be used for the grid in the domain G. 

Let v be a grid function defined on the grid u> h and satisfying the 
boundary condition t;| = 0. Also, it will be sensible to introduce the 

function 

f v(x), x E 0J h , 
v(x) = < 

l 0, x 6 0J h \uj h . 


By definition, 


v 


U) h 


V 


U) h 


where 


II HI 2 = ( v g), (v,y) 

v\\l h = J 2 

x£ui h 


v(x)y(x)h 1 h 2 , 

*€ uk 



o 


With these relations established, we deduce that estimate (19) holds for 
any function v(x) defined on the grid uJ h in the domain G, providing the 
values 

6 0 = 8(/- 2 +/- 2 ), A 0 = 4(A- 2 + / l - 2 ) ) 
where Zj and Z 2 are the sides of the rectangle G. 

4. The embedding theorem. Various a priori estimates for the equation 
Ay = ip can be obtained in the energy norms in light of the properties 
of elliptic operators. One might expect that the energy estimates imply a 
uniform estimate, that is, an estimate in the norm 

II V lie = max'| y{x) |. 

i6uk 

The following grid theorem gives a definite answer to this hint. 

0 

The embedding theorem. For any function y(x) E flh defined on 
the grid Q h = {x ; = (^ h 1 ,i 2 h 2 ), i a = 0,1,... , N a , h a = l a /N a> a = 1,2} 
and vanishing on the boundary (for x a = 0, l a ; a = 1,2) the estimate 

(20) \\y\\ c <M 0 \\Ay\\ 
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is valid with 

1 2 

Ay = -fe,!. - Vs 2 :v 2 - Mo = !L- = , / 0 = max (/ 1 ,/ 2 ). 


Proof Suppose that v k k (x) and A klk2 (x ) are the eigenfunctions and eigen¬ 
values of the operator A that we have determined in Section 1 for k a = 
1,2,... , N a — 1 and a = 1,2. The expansion of the function t/(x) with 
respect to the orthonormal functions {u i . i j, 2 (x)} 

2/0*0= E 

fc i , A? 2 

yields 

A V = E c kik 2 ^kik 2 v kik 3 ’ 

A" 1 , £ 2 

II»II 2 = E 

Ai i, Ai 2 

IIE/|| 2 = E c lk 2 X lk 2 - 

All I A2 

The function t/(x) satisfies the inequality 

12/(E I < ( E I I) P a , x I CtniEE I ■ 

Sfcj.fca 7 

From formula (5) we get \ v kik2 (x) \ < 2/yp 4■ Applying the Cauchy- 
Bunyakovskii inequality we establish the chain of the relations 

(2i) EE) I 2 < A- 

l 1 l 2 

4 

0 0 



< 


0 0 


E x lk 2 c tk 2 E 

fejT'2 *i,*2 


4 

0 0 


\\Ayf E A 


-2 
A: i A: 2 


k i, A; 2 
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With this in mind, it remains only to evaluate the remaining sums 


£ a 


k i k 2 


Ar? + 


* lt k' 


N i — 1 !Vq — 1 

£ £ 

*1=1 *2=1 
*1 + *2 >2 


k i k o 


Because the function sin ip I ip is monotonically decreasing on the segment 
0 < p < tt/ 2 and, therefore, sin ip > ‘lipj'K, formula (4) reduces in this case 
to 


'k 1 k 2 


P 


sm tp x 
Pi 


t ' 2 K 

p 


fl^\ 2 >A ( k ± + k l 


P 2 


where tp a = irh a k a /(2l a ), a = 1,2. Using this estimate behind, we obtain 


N i — 1 N~2 — 1 


g4 N i-l 7V 2 -1 ^ ^4 

16 ^ ^ V ' 1 1 ’' 2y = 16 J ' 
*i = l k 2 =1 *i = l 


£ £ Uimd; £ £ « + b 


*i - (-*2^ > 2 *i - (-*2^ > 2 

Majorizing the sum J by the integral 

oo K / 2 


J < 


r dr dp tt 


i o 


8 8 16 

and taking into account that A, , > i5 0 = — + — > —, we deduce that 

) /2 12 / 4 


P P ~ l 4 

‘l *2 *0 


( 22 ) 


5 < 


A. 

16 2 


■/) 


4 ■ 16 


1 

64 



Substitution of (22) into (21) yields inequality (20). 

5. Equations with variable coefficients. The Dirichlet problem for the 
elliptic equation in the domain G + T = G comes next: 


(23) Lu=—f(x), x 6 G, u = p(x), i6f, 


with a rectangle G = {0 < x a < l a , a = 1,2} and 


2 

Lit — ^ ( L <y it , 

Of=l 
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where k a {x) are sufficiently smooth functions, 0 < c ; < k a {x) < c 2 , a = 
1,2, with constants c : > 0 and c : > 0. We compose in just the same way 
the grid with steps h 1 and h 2 and denote it by ui h = uJ h + j h as we did in 
Section 1. 

An excellent start in this direction is to approximate the operator L a 
by the difference operator 


A« u = 


L n U = 


dx r , 




where a a (x) is so chosen as to satisfy the relations 

(24) A a u — L a u = 0(/i 2 ), 0 < c 1 < a a (x) < c 2 . 

This means that A a provides an approximation of order 2, for instance, for 
a a = ^( -0 ’ 5 “) or 

a ex 

a i( x i > x 2 ) — k 1 (^x 1 — 2 hy , r 2 ), a 2 (x 1 ,x 2 ) — k 2 (^x 1 ,x 2 — 2 h 2 ) • 

The next step is to put the operator A u = u in correspondence 

with the operator Lu due to which the difference Dirichlet problem 


A y=-ip, x G ui h , y = y(x ), x G j h , 

(25) 

At/= (A x + A 2 )j/, A a y= (a a y x J Xa , 

having the approximation error (residual) i/> = A u + ip = 0(\ h | 2 ) will be 
associated with problem (23). 

Such an approximation is the result of a natural generalization of ho¬ 
mogeneous conservative schemes from Chapter 3 for one-dimensional equa¬ 
tions to the multidimensional case. These schemes can be obtained by 
means of the integro-interpolational method without any difficulties. 

0 

We now investigate the properties of the operator A in the space fi* 

of all grid functions with the inner product in the sense of (15). In what 

0 

follows we accept Ay — —A y for any y 6 fi. 

Lemma The operator Ay = —Ay = — A„ y, y G H, is self-adjoint , 

positive definite and admits the estimates 

0 0 
Cj (A v, v) < (Av, v) < c 2 (A v, v ), 

Cj 6 || v || 2 < {Av, v) < c, 2 A || v || 2 


(26) 

(27) 
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for any v 6 H , where 

oo 2 

Ay = -Ay = -J2ys a x, 

a = l 


and the constants 6 > 0 and A > 0 arise from formulae (18) and (19). 

As far as = 0, the first Green formula with regard to the operator 
A a v = (a a v Sa ) x implies that 

(A a v, v) = ~(a a v Sa ,%J a> 

where 


Ni n 2 -i 

K Z ]l = X X hl > * 2 > *2 *2) *1 h 2 

*1=1 ; 2 =i 


IVj-l jV 2 

K 4 = X X U ’(*l > *2 *2) *( l 'l . f 2 *2) h 2 ■ 

* 1=1 *2 = 1 

With these representations in view, we have 

2 

(Av,v) = X] (a 0 u Sa , v s J q . 

ar = l 

On the other hand, 

0 2 

(A v, v) = ^ {v Sa ,%J a ■ 


By condition (24) we are led to (26) and so it remains only to substitute 

0 

into (26) the bilateral estimate 6 ||u|| 2 < (Av,v) < A ||u|| 2 , which has 
been obtained in Section 2. These manipulations permit us to derive (27) 
with the ingredients 


2 

\ ' 


<s= V ^ 


a = l 


4 

h? 


2/ 


E 

a=l 


4 

h? 


2L 


In what follows inequalities (26) and (27) are adopted in operator form 
and we agree to consider 


(28) q l<d<cj, 

(29) cJE < A <c 2 AE, 
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where E stands for the identity operator. 

The self-adjointness of the operator A = A\ + A 2 can be proved by 
exactly the same reasoning as in Section 2 with further reference to some 
properties such as 

A* a = A a >0, A a y = -A a y = -(a a y Sa ) Xa for y £ Q h . 

To make sure of it, it suffices to calculate the row sum with a = 1 for fixed 
i 2 = 1,2,... , N 2 — 1. The outcome of this is 

JVi -1 JVi -1 

J2 ( Al % h l = “ J2 (“l v £ h l 

*1 = 1 b = l 


JV 1-1 

= J2 2A'i ( Q 1 h i 

*1 = 1 


N i-l 

= Vii ( A 1 v )ii h l ' 

*1 = 1 

Multiplying this identity by h 2 and summing over i 2 = 1,2,... , N 2 — 1, we 
establish (Aiy,v) = (y,A\v) and, in a similar way, (A 2 y,v) = (y,A 2 v), 
yielding 

(A y, v) = ((A! + A 2 ) y, v ) = (y, Av) . 

By definition, this means A* = A. 

6. Equations with mixed derivatives. In this section we consider problem 
(23) involving the elliptic operator L with mixed derivatives 

2 dr du \ 

(30) Lti — ''y ' L a y U, — 7S \ k cx6 "X ) ; 

Q %y «9x a V P dxpj 

assuming the ellipt'icity conditions 

22 2 

( 31 ) C 1 Zl < k ay{ x )‘a£y < C 2 xeG, 

qi = 1 a, (3 — l o = l 

to be valid, where c 1 > 0, c 2 > 0 are constants and £ = (^ , £ 2 ) is an 
arbitrary vector. Setting first = 1, £ 2 = 0 and then = 0, £ 2 = 1 it is 
not difficult to check that 


0 < Ci < k aa < c 2 , 


a= 1,2. 
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In this line, the operator L a p u is approximated by the difference op¬ 
erator 

(32) A a/3 u ~ \ {(k a p + (k a p U x p) Sa ) , 

which is defined for a / j? on the. 7-point pattern (see Fig. 15) consisting 
of the nodes 

(Xj , £ 2 )l (^1 ^1 1 ^2)1 (^1 ! ^2 ^2)1 (^1 kly , x 2 ^2) ■ 


X 

(^1 J ^2) 




hi 


Figure 15. 

The operator A a p arranges itself as a sum 

h-ap — 2 (h. a p +A.^) , ^ a pU ~ {k a p U i/3 ) x ^ , k.+pU=(k a pU Xfj )_". 

We are going to show that \f 2 and A 12 have the first and second order of 

approximation, respectively: 

(33) Af 2 u = Li _2 u -\- 0(h 1 /i 2 ), Aj 2 u — Aj 2 u -\- 0(\ h | ). 

Indeed, we refer to the operator A(~ 2 u = (k 12 u S2 ) . Substituting here the 

expressions 

du h 2 d 2 u h 2 d 3 u , _ , _ . , 

= lh 2 ~ Y d^ 2 + Y X2 e [*2 - A 2 . *2]. 


V 


xi 


dv 

dx 2 


h t d 2 v 
2 dx 2 


0(hD 



288 


Difference Schemes for Elliptic Equations 


for v = k 12 u s yields 


An 


^12 U + -jf n- -A 12 U 


5_ 

dx. 


E”lE 0(l '‘ p) 


Likewise, 


\+ t h i d T 

\T 2 u = L 12 U- — A 


2 dx. 


2 u +’^ L t2^ + °(\ h \ 2 ), 


from which estimates (33) follow immediately. 

When a = (3 = 1 and a = j3 = 2 we might have 


A u u = \ 

A 2 2 u = I 


((El u xi)xi + (E 
(^(k 22 UjJi 2 + (k 22 


u *l. 


= ( a n 


)#i 

u x 2 . 

1 * 2 ) : 

= ( fl 22 

u s 3 . 

).V2 1 


where 


a n — 2 [El ("*"1 E i ^2) d" Ei Ei 1 ■*'2)] 1 

^22 — 2 [^22 El 1 ^2 E) d - E2 Ei > ^ 2 )] • 

From the preceding relations it seems clear tha.t A aa u — L aa u = 0(h 2 ), 
a = 1,2. Thus, the differential operator (30) is approximated to second 
order by the difference operator 


2 

A 2 / = E A a py, 

cx, (3 = 1 


meaning 

Au-Lu = 0(|/i | 2 ). 

In addition to operator (32), we take into consideration one more operator 
with the values 

2 _ _ 

A2/= E A a(3 y, A aP y = \ [(k a/3 y ) Xa + (E/3 2/.f J.fj . 

a ,/3 = 1 

providing an approximation of 0(\ h | 2 ). 
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Let us investigate the properties of the operator Ay = — Ay for any 
y E Q h = H . The operator Ay = | + El+y) with the members 

2 2 

A ~y = - E (E/3 2/^)^ , ^ + i/ = - E ( k a /3ys 0 ) x 

or, /?=1 cv, /? = 1 

is self-adjoint: A = A* for k 12 = & 21 and admits both estimates (28) and 

(29). 

The operators A and A + will be the subject of separate investiga¬ 
tions. For arbitrary elements y, v £ H the summation by parts formula 
yields 

2 2 

(34) (A + y,v) = - ii k aP yx<,)x a > v ) = T ( k apy s ^ v s a \ 0 , 

a, ft— 1 a, {3 = 1 

2 2 

(35) (A-y,v)-~ J2 (( k apy Xf) )x a ,v) = J2 [ k apV x ^ v x J a - 

a, /?— I a, /5 = 1 

The interchange of t/ and v followed by that of a and (3 results in the 
relations 

2 2 

(A + v,y)= (E/3 % ,y Sa ] Q = T > u s«b- 

a, /5 = 1 cv, /5 = 1 

Putting these together with (34) we verify that (A+)* = A + only if k 12 = 
k 21 . In a similar manner it is plain to show that in this case (A - )* = A~ 
and, hence, A* = A. In this regard, it is necessary to take into account 
that y Xi = 0 for x 2 = 0 and y Sl = 0 for x 2 = / 2 , while y X2 = 0 for x x = 0 
and y s — 0 for x } = l } . Passing now to the expression (A + y,y), which is 
always representable by 

2 N 2 -1 

( A+ y,y)= J2 ( k °P Vx^ysJ + J2 (bniy^) 2 ) h=Nl h i h 2 

Q',/5=I i 2 = I 

Nx~ 1 

+ T ^22 (Vx 2 ) )i 2= N 2 E ) 

*1 = 1 

we carry the sum over a, [3 under the sign of the inner product in the first 
summand, leading by (31) to 

k af3 y$0 1 ys a \ — c 2 

1 / a=l 


J2 ((^J 2 . 1 ) • 


c i T ((^J 2 - 1 ) - ( T 

or=l \a,0~ 
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The expression for (A y, y) can be transformed without difficulties 

0 

in just the same way. Recalling now that c x < k aa < c 2 and ( Ay,y ) = 

,2/jJa w e obtain c } A < A < c 2 A, yielding inequalities (28). 
Inequality (29) can be deduced from the above relations by virtue of the 

estimate S E < A < A E. 


4.5 HIGHER-ACCURACY SCHEMES FOR POISSON’S EQUATION 

In this section we consider higher-accuracy schemes for the Dirichlet prob¬ 
lem (1) of Section 1 in a rectangle. 

1. The statement of the Dirichlet difference problem providing a higher- 
order approximation. On the basis of the “cross” scheme it is possible to 
construct a scheme with the error of approximation 0(\ h | 4 ) or 0(h 6 ) on a 
solution in the case of a square (cube) grid. In order to raise the order of 
approximation, we exploit the fact that u = u(x) is a solution of Poisson’s 
equation 

(1) A u = -f(x). 

Without loss of generality we may restrict ourselves to the careful analysis 
of the two-dimensional case (p = 2) where 


A u = Li u + L 2 u . 


L n u = 


d 2 u 
dx 2 


by appeal to the difference operator 

A u = {K x + A 2 ) u , A a u = u Sa3 . a , 

assuming u = u{x) to possess all necessary derivatives. Then 


( 2 ) 


A L\ u + 0(| h | 4 ). 


From the equation L x u + A 2 u — —f(x) we find that 


L/ x v i — f L\ L/2 u, L 2 u — F 2 f L 1 L'2 h , 


that 


(3) A u=Lu-^ L x fL 2 f- h LJ^l Lx L 2 u + 0(\h\ 4 ) 


K 


12 
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Figure 16. 

We substitute here Lu = —/ and replace LiL 2 u by the difference operator. 
The outcome of this is 


A i A 2 u = u SiXiS2X2 ~ L x L 2 u 


dx\ dx\ 


This operator is defined on the nine-point pattern shown in Fig. 16. 
The expression for Ai A 2 u such that 


Ai A 2 u = Ai 


i{x l , x 2 — h 2 ) — 2 u(x 1 , x 2 ) + u(x 1 , x 2 + h 2 ) 


{ u(x i — h 1 , x 2 — h 2 ) — 2 u(x j , x 2 — h 2 ) 


+ u(x j + h 1 , x 2 — h 2 ) + 4 u(x 1 , x 2 ) 

— 2 u(x 1 — /ij , x 2 ) + u(x 1 — h 1 , x 2 + h 2 ) — 2u(x 1 , x 2 + h 2 ) 


2 u(x^ + /ij i x 2 ) u(x i + /ij j x 2 T ^ 2 )} 

is needed in the estimation of the error of approximation to Ai A 2 u—L\ L 2 u 
by virtue of the well-established expansion 


At = v Sx = 


+ h) — 2 v(x) + v(x — h) 


'( 0 . £ = * + | 0 |< 1 , 


( 4 ) 
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assuming that v(x) has a continuous second derivative on the segment 
[x — h, x + h]\ 

(5) An = v Sx = v"(x) + ^ « (4) (r), £*-x + 0*h, 16'* | < 1, 

v(x) has a continuous fourth derivative on the segment [x — h, x + h\. By 
relating x 1 to be fixed we might have 


< 1 


h 2 d‘ l u 

A 2 H — L /2 u(x j 3 ^2) + ^ 2 Q 4(^1 5 £2); £2 — X 6 ^ h 2 3 

Other ideas are connected with the expression 

h 2 d 4 u 

Ai A 2 u(xj , x 2 ) = Ai L 2 u(x 1 , x 2 ) + y| A x ^(aq , 4). 

Applying formula (5) with v = L 2 u and x = x 1 to the first summand yields 

fl 2 Q4 U 

A i L 2 u(x 1 , x 2 ) = L 1 L 2 u{x, , x 2 ) + . x 2 ) 

£,* = *1 + ^ A i. 1 e \ I < 1. 

The same procedure works for the second summand with respect to formula 
(4): 

h 2 B 4 u h 2 (9 6 u 

u Al d^ {Xl ^ 2)= u d^fdi ^ = I 1 + 9 1 A > | 

What should be done is to bring together the results obtained: 

(Ai A 2 - Ai L 2 ) u = 0{h\) + 0(h 2 2 ) = 0(| h | 2 ). 

Substituting into (3) the expression for Ai A 2 u in place of L\ L 2 u 
Li L 2 u = Ai A 2 u + 0(| h | 2 ), 
and involving the equation Lu = —f(x), we finally get 
h? -\- h? h? h? 

( 6 ) Au = Lu-^j^A l A 2 u-^L l f -^L 2 f + 0{\h\ 4 ) 


( h 2 h 2 \ h 2 + h 2 


Ai A 2 u + 0(| | 4 ), 
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Because of this, the equation 


{ h 2 + h 2 

A 'y = -<p, A'y = A y + - 1 —- x — ! - A x K 2 y , 

v = f+ + 

provides an approximation of order 4 on a solution u = u(x) of Poisson’s 
equation (1). Indeed, formula (6) gives 

A'u + p - (A 'u + ip) - (L u + f) = 0(| h | 4 ), L = A + L 2 . 

The operator A' is defined on the nine-point “box” pattern (see Fig. 16) 
consisting of the nodes (a; 1 +??r 1 h 1 , x 2 +m 2 /i 2 ); m 1 , m 2 = —1,0,1, by means 
of which scheme (7) is representable by 


( 8 ) 


5 _l_ _ 1 / _5_ 

3 1 h 2 + hi J y 6 \h 2 


1 

h 2 


(?/ +ll) 




I (A. 

+ 6{h 2 


h 2 


(:y (+l2) 


,(-i= 


} ) 



+ (y(- ll, - l3 ) + y(- ll,+l3 )) + <p, 

where t/^ 1 ) = ^(aq ± /q ,x 2 ), j/( +111 — 1 -) = t/(xq +h i ,x 2 — h 2 ), etc. On the 
square grid (h l = h 2 — h) the final result is simple to follow: 


4 ilh + 2/2 + 2/3 + Vi) + 2/5 + Ve + 2/7 + % . 3 2 

w n =-- h ip 

y ° 20 10 ^ 

(see Fig. 16). 

To avoide cumbersome computations, we substitute A 1 / for L\ f and 
A 2 / for L 2 f into the formula for <p having replaced ip by 0(| h | 4 ), which 
does not change the order of approximation for ip = A'u + ip = 0( \ h | 4 ), so 
that 

h 2 h 2 

7 , = /+ Y2^ 1 ^”*"Y2^ 2 ^' 
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2. Estimation of a solution of the difference boundary-value problem. Con¬ 
sider now the difference Dirichlet problem for the scheme of accuracy 
0(| h | 4 ) in the rectangle G = {0 < x a < l a , a = 1,2}: 

f A 'y=-ip, xE uj h , y\ 

( 9 ) | h\ h 2 

where A 'y is given by formula (7). Each of the grid nodes is regular, because 
the nine-point pattern belongs to the rectangle G (Fig. 16). The boundary 
j h of the grid contains all the nodes on the boundary T including the 
vertices of the rectangle. With this in mind, we set up the problem for the 
error z = y — u: 


(10) A 'z = -ip, xE u) h , z = 0 on j h , 

where ft = A 'u + ip = 0(\ h | 4 ) for x E ui h if u E To decide for yourself 

whether the conditions of the maximum principle are satisfied, a first step 
is to compare (8) with (1) from Section 2. As a final result we get 

(11) B(x,£)> 0 for 4=<^<\/5. 

v 5 ^2 

To evaluate the solution of problem (10), we should have at our disposal 
the majorant of the type 


Y(x) = K (ll - xl + Z 2 2 - x 2 ) 


Taking into account that AY = —AK, Ai A 2 Y = 0, ||Y|| < A'(Z 2 + Z 2 ) 
and accepting AK = II "0 Ilc> we deduce by Theorem 3 for the solution of 
problem (10) the estimate 


< 


Z 2 + Z 2 


IV’I 


< 


v/5 ~ h. 


< a/5 


provided that the condition 
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holds. This implies that 


Scheme (9) is of fourth-order accuracy when u £ 
f £ and condition (11) is satisfied. 


It is worth noting here that on the square grid (h i = h 2 = h ) this 
condition is automatically fulfilled. A proper choice of ip guarantees the 
sixth order of accuracy of scheme (9) on any such grid. Convergence of 
scheme (9) with the fourth order in the space C can be established without 
concern of condition (11). An alternative way of covering this is to construct 
an a priori estimate for || Az || 2 and then apply the embedding theorem (see 
Section 4). 

Let fi/j be the space of all grid functions defined at the inner nodes 

x 6 uJ h of the grid i o h = {(ij h l , i 2 h 2 )}, 0 < i a < N a , h a N a = l a , a = 1, 2, 
0 

and let fi/j be the space of all grid functions defined on the grid ui h and 
vanishing on the boundary y h . The accepted view is that an inner product 
in the space fi/j such as 


Ni-l N 2 -l 

(v, V) = y{i 1 h 1 , i 2 h 2 ) v(i 1 h 1 , i 2 h 2 ) h 1 h 2 

* 1=1 *2 = 1 

= y( x ) v ( x ) ] h h 2 , y,v £ fift , I|i/|| = \/(y,y), 

and the operators Ai and A 2 specified by the relations 


tli 1 / = ~Ai!/, A 2 y = -A 2 y, 

~ 0 

where A a y = A a y for all y E Clh, will complement special investigations. 
~ . ... ° 
Here A a really acts from fi* into fi/j and is identical with A a itself in flh- 

Therefore, A\ and A 2 are linear operators defined on Hh — (they can be 

° 0 

treated also as operators from fi/j into fi/j C fi/j). The domain and range 
of these operators coincide with fi/j = Hj t . 

Here the complete posing of problem (10) is concerned with an oper¬ 
ator equation 


(12) A'z = Ai z + A 2 z — (xj + x 2 ) Ai A'i z — i/q 


y,i> e H h , 
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with Xj = h'l ! /12 and x 2 = fi 2 /12 incorporated. The operators and A 2 
are self-adjoint: 


(A a j/, -w) = (y,A a v), 
positive definite: 


a = 1,2, y,v £ H h 


(A a y,y)> \{ c 




4 . 2 7r/i a 8 

ie sm 

a ^ cv 


a = 1,2. 


and commuting: A\ A 2 = A 2 2^. In view of this, 


A^ A2 — {A[ A 2)* > 0 . 

By virtue of the relations 

^ <\\A a \\E, ||A a .|| = ± cos 2 ^ X'WAcWk 1 - 

a a a 

we arrive at 

-' 4-1 A2 < || A\ || A2, A\ A2 = A 2 A x < || A2 1 | Ai , 

(xj + k 2 )A x A 2 = Xj A 2 + x 2 A 2 Ai 

< Xj || Ai || A 2 + x 2 II A2 || Ai 

< 5 (-< 4 i + A2) , 

yielding 


| A < A — Ai + A2 — (xj + x 2 ) Ai A2 < A , 


A = A 1 +A 2 , 


Ill^ll < IKHI < \\Az\\. 


The operators A and A' are commuting and self-adjoint and, therefore, 
for the equation A'z — ip the estimate HATH < | || V'H is certainly true. 
By the embedding theorem from Section 4, 




2^777 


Az < 


37 2 


IMIc < 
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it being understood that for any steps h x and h 2 the solution of problem 
(12) can be estimated by 


IMIc = \\y ~ u \\c ^ M \\^\\’ 


where 



l 0 = max(Zj , Z 2 ). 


The estimate so constructed implies the uniform convergence of scheme (9) 
with the rate 0(\ h | 4 ) for any ratio h 1 /h 2 . 

3. The multidimensional case. The method for constructing a scheme of 
fourth-order accuracy described in Section 1 applies equally well to the case 
of several variables, making it possible to compose the difference scheme of 
fourth-order approximation 


(13) 


(14) 


A 'y = -p{ x ), y = K x ), £ 67 h , 

P h 2 1+p 

A'y = A y + ^ A„A y y , 

a = 1 P ^ cv 


A y = A « y > = y Sa 

a=l 

P h 2 

* = /+£ Tf *„/, 




associated with problem (1) of Section 1 in the p-dimensional parallelepiped 
G 0 = {0 < x a < l a , a = 1 , 2, ... , p} on the grid 1 u h = {x { = {i 1 h 1 , ..., 
i p h p ), i a = 0,1,2,.. . , N a , h a N a = l a }. 

By introducing the space Hp = fi/j and the operators A a by analogy 
with the preceding,section we draw the conclusion that the operator 

p p ^2 P 

(15) A' = A - ^2 H a Aa Ap , K Q = , A = ^ A a , 

a = l a = l 

Pyta 

is self-adjoint and possesses the estimates 

A < A' < A , 


3 


p > 1 ■ 
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These properties are an immediate implication of the chain of the relations 

= = p -^ a ■ 
cv — 1 p^.a a — 1 p^a a = l 

For p > 4 the difference operator (15) lacks the property of having fixed 
sign (ellipticity). In each such case it is recommended to refer to another 
operator A', which preserves the ellipticity property for any p\ 

p p f h 2 \ 

A 'y = J2 II P+7fAjA a y 

a=l p =l \ ) 


or 

P 

P 

(16) 

W8 

ii 

n< £ 


It is evident that the approximation order remains unchanged and A' is 
identical with operator (15) up to the terms 0( \ h | 4 ). 

On the other hand, since E — Kp Ap > | E, 


A' A o, 

or= 1 


2\p-i 

3/ 


2 

3 


p- i 

A 


and, hence, 


2 

3 


p -1 


A < A' < A . 


With the aid of the above operator inequalities we are able to produce 
the necessary a priori estimates and justify the convergence with the rate 
0(| h\ 4 ) for the scheme in hand. Observe that for p = 2 operator (16) 
coincides with operator (15). 

We have nothing worthwhile to add to such discussions, so will leave 
it at this. 



Difference Schemes for 
Time-Dependent Equations with 

Constant Coefficients 


In this chapter difference schemes for the simplest time-dependent equations 
are studied, namely, for the heat conduction equation with one or more 
spatial variables, the one-dimensional transfer equation and the equation 
of vibrations of a string. Two-layer and three-layer schemes are designed 
for the first, second and third boundary-value problems. Stability is inves¬ 
tigated by different methods such as the method of separation of variables 
and the method of energy inequalities as well as by means of the maximum 
principle. Asymptotic stability of difference schemes is discovered for the 
heat conduction equation in ascertaining the viability of difference approx¬ 
imations. Finally, stability theory is being used, increasingly, to help us 
understand a variety of phenomena, so it seems worthwhile to discuss it in 
full details. 


5.1 ONE-DIMENSIONAL HEAT CONDUCTION EQUATION 
WITH CONSTANT COEFFICIENTS 

In this section we consider the one-dimensional heat conduction equation 
with constant coefficients and difference schemes in order to develop various 
methods for designing the appropriate difference schemes in the case of 
time-dependent problems. 
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1. The original problem. The heat diffusion process on a straight line is 
described by the heat conduction equation 


( 1 ) 



d / du 

fa fa fa 


+ / > 


where u = u(x,t) is the temperature, c is the specific heat, p is the density, 
k is the thermal conductivity and / is the density of heat sources, that is, 
the amount of heat emitted per a unit of time on a unit of length. Thermal 
conductivity and specific heat may depend not only on x and t , but also 
on the temperature u. In that case the equation is said to be quasilinear. 
If k and cp are constant, equation (1) can be written in the form 


( 2 ) 


du 

~di 


d 2 u ~ 
dx~ 2+i ' 



f = 


cp ’ 


where a 2 is the thermometric conductivity (Maxwell) or diffusivity (Lord 
Kelvin). 

Without loss of generality we may set a = 1 and rewrite equation (2) 
as 


( 3 ) 


du d 2 u 

~dt = fa 2 +f ‘ 


Indeed, by introducing x' = x/a and denoting once again x' by x we obtain 
(3). Where searching a solution to equation (2) on the segment 0 < x < /, 
it is sensible to pass to the dimensionless variables 


/ 

x 


x 

1 


t' = 


a 2 t 


whose use permits us to rewrite equation (2) in the form (3) with 0 < x' < 1 
and / = l 2 f / a 2 incorporated. 

We concentrate primarily on the first boundary-value problem associ¬ 
ated with equation- (3) in the rectangle _D = {0<:c<l,0<f<T},in 
which it is required to find a continuous in D solution u = u(x,i) of the 
problem 


du d 2 u 



m = fa^ + fix ’ th 

0 < x < 1, 

0 < t < T, 

u(x, 0) = u 0 (x) , 

0 < x < 1 , 


u(0, t) = Uj (t) , u(l, t) = u 2 (t ), 


0 < t < T. 
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2. The family of six-point schemes. As before, it will be convenient to 

introduce the grids Q h = {xq = ih, i = 0,1,... , At} and uj t = {tj — 

jr, j = 0,1,..., j 0 }. When operating in D on the grid 

u hT = x = {(ih, jr), i = 0, 1, .. . , At, j = 0, 1, .. . ,j 0 } 

with steps h = l/N and r = T/j 0 , we denote by y? the value at the 

node of the grid function y given on tl> hT . The approximation here 

consists of replacing the first derivative du/dt by the first order difference 
derivative, the second derivative d 2 u/dx 2 by the second-order difference 
derivative u sx = A u and introducing an arbitrary real parameter cr. As a 
final result we get a one-parameter family of difference schemes 

(4) ^ ^ ■■ Vl ' = A (a y? +1 + (1 - a)y? ) + , 0 < i < N, 0 < j < j 0 . 

Sometimes scheme (4) will be treated as a scheme with weights. The 
supplementary boundary and initial conditions will be explicitly specified 
with accurate approximations: 

(5) i/o=w}, y 3 N = u l, 

( 6 ) y° = y(xi, 0 ) = u. 0 (xi). 

Here ip- is a grid function approximating the right-hand side / of equation 
(3). With such a variety, we may accept, for example, 

<Pi = f( x i> *j+i/ 2 ) > *j+i/ 2 = h +0.5r, 

^ Vi ~~ Vxx, i ~~ ( Vi— i ^ Vi Ui-\- 1) / ^ * 

When all conditions (4)-(6) are put together, they are constitute problem 
(”)' . - . 

The difference scheme (4) is constructed on the six-point pattern with 
the nodes 


(Xjjii, tj_ |_j) , (x,', tj_ |_j) , (Xj-J-J, tj) , (Xj, tj ) 

and center (x it tj +1 ) (see Fig. 4,c). The truth of equation (4) is supposed 
at the nodes (x s -, tj +1 ), i = 1,2,... , N — 1; j + 1 = 1,2,... ,j 0 , known as 
the inner nodes. The set of all inner nodes of the grid i u hT is denoted by 

^hr ~ {(*», tj), 1 < i < N - 1. 1 < j < jo} ■ 
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The boundary and initial conditions (5) and (6) are specified at the 
boundary nodes of the grid Co hT . All of the nodes of the grid ui hT lying 
on the straight line t = tj constitute what is called a layer. Because in 
scheme (4) knowledge of the values of the sought function y is required on 
two layers, it can be regarded as a two-layer scheme. In the sequel we 
will show that the accuracy and stability of scheme (4) depend on a proper 
choice of the parameter a. Before proceeding to further careful analysis, 
it would be prudent to examine some schemes relating to particular values 
of a in light of those remarks. For u — 0 we get the four-point scheme 
(Fig. 4.a) 


,i+ l 


- Vi 


- A y 3 + 


•Pi 


or 


(7) y- +1 - (! - 27 ) y? + + t// +1 ) + t ipf , j = T /h 2 , 

developed on the pattern with the nodes (ap, f- +1 ), (ap, tj) and (x i±1 , tj). 
The value y 3+1 at every point of the new layer t — f- +1 is given by the 
explicit formula (7) through the values y 3 on the previous layer t = tj . Since 
the solution is prescribed by the initial condition y° = u 0 (x i ) at moment 
t = t 0 , it is possible to determine all the values of y on any adjacent layer 
by applying successively formula (7). Because of this, scheme (7) is said to 
be explicit. 

For (7 yf 0 scheme (4) refers to an implicit two-layer scheme. When 
the value y? +i is sought on the new layer under the natural premise a yf 0, 
we obtain the governing system of algebraic equations 

(8) o’ Aj// +1 — ij// +1 = -A/, F/ = ij// +(l-a)Ay? + ip?, 
i= 1, 2, TV - 1, 

subject to the boundary conditions y^ +1 = and yj^ 1 = u 3 2 +1 ■ This 

system can be solved by the right elimination method (see Chapter 1, Sec¬ 
tion 2.5). In conclusion, it is worth mentioning two other schemes. The 
first one with a = 1 known as the forward difference scheme or pure 
implicit scheme will appear as further developments occur: 


(9) 


r 


A y/ +1 + . 
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The six-point symmetric scheme with cr = 0.5 ascribed to Crank and 
Nicolson is of the form 


( 10 ) 


,j+i 


A \yl + +yf ) +<p 


3. The error of approximation. In order to evaluate the accuracy of scheme 
(4)—(6), the solution y = y- of problem (4)-(6) should be compared with 
the solution u = u(x,t) of problem (I). Since u = u(x,t) is the continuous 
solution of problem (I), we may set u- = u(x it tj ) and deal then with the 
difference z? = -y- — u- . For this, the first step in the estimation of the grid 
function zf on the relevant layer is connected with norms || ■ || of proper 
form, for example, 


max Zj 
0 <i<N 


n-i \ 1 / 2 

E -4 h 

i = 1 


Let us pass, time and again, to the notations without subscripts and su¬ 
perscripts, which are good enough for our purposes: 


y = y, 


■y- +1 = y, 


yt = (y- y)h , 


permitting us to recast the problem we have completely posed by conditions 
( 4 )~(6) as 


y t = A (o- y + (1 - o-) y) + ^, 

(II) y(0,t)=u 1 (t), 2/(1, t) = u 2 (i ), 

y(x, 0) = u : (x) , 


(a,', f) G ojj lT , 
t G oj t , 

*^ 1 , A v = y£ X - 


In trying to establish the conditions for determination of z = y — u we 
substitute y = z + u into (II) and regard u as a known function, making it 
possible to set up the problem for z\ 

Z t = A (<TZ+ (1 - a) z) + ^ , (x,t) Gw 4t , 

(III) z( 0, t) = z(l, t) — 0 , t G lo t , 

z(x, 0) = 0 , x G Co h , 

where 


(11) 


ip = A ( a u + (1 — a) u ) — u t + yz 
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is the error of approximation (residual) for scheme (II) on the solution 
u = u(x,t ) to equation (I). 

Recall the definition of the order of approximation from Chapter 2, 
Section 1.3 saying that scheme (II) approximates equation (I) with order 
( m,n ) or equation (I) is approximated by scheme (II) to 0(h m + r n ) on 
a solution u = u(x,t ) to equation (I) if || ip(x, t) ||^ = 0(h m + r n ) or 
II i’ 11(2) — M (h m + T n ) for all t 6 u> T , where M is a positive constant, not 
depending on h and r, and || - ||^ is a suitably chosen norm on the grid 
■ 

We proceed to the estimation of the order of approximation for scheme 
(II) under the agreement that u = u[x,t ) possesses a number of derivatives 
in x and t necessary in this connection for performing current and subse¬ 
quent manipulations. Within the notations 

du,du_ 

u — — , U — — , U — U(X U tj +1/2 ) , tj + j/2 = tj + 2 r > 

the development of Taylor’s series for the function u = u(x,t ) about the 
node (Xf,tj +1 j 2 ) leads to the expressions: 

it = 0.5(u + u) + 0.5 (u — u) = 0.5(u + u) + 0.5ru i , 

u = 0.5 (u + u ) — 0.5 r u t , 

<7u + (1 - a) u = 0.5 (u + u) + (ir - 0.5) r u ( . 

All this enables us to reduce xp to ip = 0.5A(u + u) + (cr —0.5) r A u t —u t +tp. 
Substitution of the set of expansions 
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yields 

h 2 

(12) ip = (L u — u + p) + (cr — 0.5) t Lii+ — L 2 u + 0(h 4 + r 2 ) , 

whence it follows that ip = (cr — 0.5) tLu + 0(h 2 + r 2 ) for p = / = 
f(x, since ii = Lu + f. By virtue of the relations L u = L 2 u + Lf = 

u ( 4 i + /" and L 2 u = Lu — L f and expression (12) we are led to 


(13) ip = (p-f) = (cr-§)r+i/i 2 £ « - h 2 Lf + 0(h 4 + r 


By equating the expression in the square brackets to zero we find that 

(14) (7 = 


h 2 

12 r 


For cr = (7* and ip = f + -p^ h 2 Lf scheme (II) generates an approximation 
of 0(h 4 + r 2 ), that is, ip = 0(h 4 + r 2 ). But the order of approximation of 
this scheme remains unchanged if /" will be replaced by f Sx ~ A /, giving 

i 9 = / + 12 ( h2 A /) or 


(15) 


ft 


5 rj+l/2 

6 • 


1 

I ~2 


J_ [ fj + U 2 , rj+1/2 
lO \ ^i — 1 +1 


Observe that the last formula is much more simpler for later use. 

Let Cfp(D) be the class of functions with m derivatives in x and n 
derivatives in t, all derivatives being continuous in D. Formulae (13)—(14) 
justify that scheme (II) provides approximations of 

• 0(h 2 + r 2 ) for a = 0.5, <^ = /or<^ = / + 0(h 2 + r 2 ) if u G CjJ , 

• 0(h 2 + r) for any cr yt 0.5, ip = f + 0(h 2 + r), for instance, <p = f 
or 99 =;/ if u G C|, 

• 0(h 4 + t 2 ) for cr = cr* and tp specified by formula (15) if u G Cf. 
Scheme (II) with a. = cr* and p = f + h 2 A f is usually termed a higher- 
accuracy scheme. The requirement of the retention of the approximation 
order for a given value a guides a proper choice of the right-hand side p. 
Thus, for cr = 0.5 it is taken to be p = 0.5 (/ + /), p = / and more. 

It is easily seen from (13) that the error 0(h 2 + r 2 ) may be also 
achieved for cr yt 0.5 if we keep a = 0.5+ h 2 a/r t where a is an arbitrary 
constant independent of h and r. Certainly, in this case cr depends oil h 
and r. The arbitrariness in the choice of a is limited by the condition of 
stability of the scheme (a result is ensured under the constraint a > — 
for more detail see Section 4). 



306 


Difference Schemes with Constant Coefficients 


4. Stability with respect to the initial data. Let us investigate the stability 
of scheme (II) with homogeneous boundary conditions by the method of 
separation of variables. For this, we proceed as usual. This amounts to ap¬ 
plying to scheme (II) with homogeneous boundary conditions the identities 

y-y + jyt , <ry + (i-<r)y = y + <rTy t 

and reducing them to the following ones: 

Vt ~ vrAy t = Ay+ p, (x,t)Eui hT , 

(16) 2/(0, t) = 2/(1, t) = 0 , t Eoj t , 

y(x, 0) = u 0 (x) , xEG) h . 

Scheme (16) is said to be stable if for a solution of problem (16) the 
estimate holds: 

( 17 ) II 2/(1) ll (1) < |K || (1) + M 2 Q maxJ| p{t‘) || (2) , 

where M i, and M 2 are positive constants independent of h and r, || • ||^ 
and || • ||^ are suitable norms on the grid u>h- 
With p = 0 incorporated, the estimate 

( 18 ) lll/WII(i) < M i II u o )!!(!)- 

expresses the stability of scheme (16) with respect to the initial data. When 
t/(x, 0 ) = 0 , the meaning of the stability of scheme (16) with respect to the 
right-hand side is that we should have 

(!9) l|y(0ll(i) < M 2 Q max || <p(t') || (2) . 

The stability of scheme (16) with respect to the initial data and the right- 
hand side is ensured by estimate (17), valid for the solution of problem 
( 16 )- 

Before giving further motivations, let us represent the solution of prob¬ 
lem (16) as a sum y = y + y, where y is a solution of the homogeneous 
equation 

(16a) y t - ut Aiy t = Ay , 2/(0, t) = iy(l, t) = 0 , y(x, 0) = u 0 (x) , 

and y is a solution to the nonhomogeneous equation with the initial condi¬ 
tion y(x, 0 ) = 0 : 

(16b) y t ~ ar ky t = ky + p , 


2 /( 0 , t) = ?/(l, i) = 0 , y(x, 0 ) = 0 . 
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To decide for yourself whether scheme (16) is stable with respect to the 
initial data, a first step is to evaluate the solution of problem (16a). This can 
be done using the method of separation of variables and deriving estimate 
(18) in the grid L 2 ( w ft )-norm: 


- N- 1 

IMIm = IMI> where II2/11 = V(y, v) , ( 2 /, = E % c-^ • 

y J i = 1 

To develop those ideas, we seek the solution to equation (16a) as a product 
of two functions, one of which T = T(tj) depends only on t = tj and 
the other X = X(aq) only on x = x i under the approved decomposition 
y(x, t ) = X(x) T(t). Substituting this expression into (16a) and taking 
into account that 


Ay — T A X , 
we arrive at the relations 

T~T A X 


Vt = XT t , 


-A, T = T(tj +1 ), T = T(t j ), 


t (aT+ (1 — a)T) X 
where A is a separation constant. As a final result we get 

1 _ (1 - a ) T A 


T = qT , 


1 + a t A 


The difference eigenvalue problem for X can be viewed as the Sturm- 
Liouville difference problem: 

AI(x) + A/Y(i') = 0, 0<x = ih<l, X(0) = X(l) = 0, X(x)^0, 

which has been under consideration in Chapter 2, Section 3.2. As stated 
therein, the problem in view has nontrivial solutions identical with the 
eigenfunctions 


X ^F(x) = v/2 sin Trkx , k = 

wich correspond to the eigenvalues 

k = 1, 2, ... , N ~ 1, 
4 


4 . 2 7 rkh 

A i. = —r sm - 

k h 2 2 


4. 2 

A, = ^ sm — , 


A 


1, 2, ... , N ~ 1 , 

0 < Aj < ■■■ < A n _j , 
o 7 rh 


N- l 


P cos T 
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The eigenfunctions {X^} constitute an orthonorma.1 system 

( X ^),X^) = 6 kuk2 , 

for which Parseval’s identity takes place: 

(20) II/II 2 = N f: fl- 

k =i 

Here f k are the coefficients of the expansion for an arbitrary grid function 
f(x) defined on the grid u> h and vanishing at the points x = 0 and x — 1: 

/oo = N f: f k x (k \x), f k = (f,xw). 

k -1 

So, problem (16a) has nontrivial solutions y^ = T k X^ ^ 0, where 
T k can be recovered from the equation 

(21) T k = q k T k 
or 


1 k 


Qk^ 


i+i T o 
Ik 1 k > 


Qk 


1 - (1 - cr) r X k 
l + ar\ k 


As a matter of fact, the constant T k is free to be chosen in any convenient 
way. 

A solution to equation (16a) having the form y^ = T k X ^ is called 
a harmonic of the attached number k. Clearly, this function satisfies 
problem (16a) with the initial condition u 0 (x) = T k X^ k \x). Let us find 
out the conditions under which every harmonic y^ k y k = 1,2,... , N — 1, is 
stable. From the recurrence relations 

(22) y{£ =X^ T/ +1 = q k X W T>, y$ = q k y{ k) 

the conclusion can be drawn that for \q k \ > 1 + e, where e = const > 0 
does not depend on h and r both, 

II V(k) II = \ Qk I II y 3 (k ) II > (! + e) II 2/(1-) II > (1 + e) J+1 || || —> oo 

as r —+ 0, that is, the problem concerned becomes unstable. If | q k | < 1 and 
t — jr is kept fixed, then ||j/(/t)|| does not increase along with increasing 

j(r-+0): 
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and the harmonic in question is stable. Under the choice | q k \ < 1, we have 
II J/(4) II < II V° k -j II- When this is the case, the scheme is said to be stable 
in every harmonic. 

We now assign the values of a such that either \q k \ < 1 or — 1 < 
q k < 1, which guarantees the stability of the scheme ill every harmonic. 
It is clear from the formula q k — 1 — r X k (1 + err A fc ) _1 that q k < 1 if 
1 + <j t \ k >0, that is, a > —(r . The bound q k > —1 or 


Qk + 1 = 


2 + (2 <r — 1) r A fc 
l + ar\ k 


> 0 


is ensured by the restriction 2 + (2 a — 1) r \ k > 0 or a > | — (r \ k ) 1 . In 
that case the condition 1 + err \ k > 0 is automatically fulfilled. Since 

4 

^k < 'V-1 < ^2 ’ 

the following relations occur: 

1 1 h 2 

-— <-;- < 

T\ k T X N ^ 4r 


Hence, the condition | q k \ < 1 holds true for all k — 1,2,... , At — 1 under 
the agreement that 


(23) 


(7 > 


1 h 2 

2 At ~~ a ° ' 


Thus, all of the harmonics = T k X^ are stable under one and the 
same condition u > u 0 . We are going to show that the stability of scheme 
(16a) in every harmonic known as the spectral stability implies that in the 
grid 1 . 2 -norm with respect to the initial data y(x, 0) = « 0 ( x )> where a : (x) 
is a grid function defined for 0 < x < 1 and vanishing at the points x — 0 
and x = 1. With this aim, the general solution of problem (16a) is sought 
as the sum of particular solutions having the form (22): 


N- l v 

y= E V(k) 

k=zl 


N— 1 . 

E T k x( k \ 

k=l 


\\y\\ 2 = e'e 2 - 

k — 1 


Substituting here T k = q k T k and taking into account (20), we find 

that 


E \ k Tk x( k \ 

k = l 


E Ql T k < m .ax q 2 k E T 2 = max q\ || y \ 

k=\ k k=l k 
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Under the constraint a > u 0 it is not difficult to verify that max | q k \ < 1 
and ||y|| < ||y|| or 

II y j+1 II < II y j II < •" <IKH = IKII- 

If so, the solution of problem (16a) satisfies the estimate 


(24) || J/' II < IK II. J = 1. 2, 


which means that scheme (16) is stable in the grid L 2 (cv ft )-iiorm with respect 
to the initial data for a > < 7 0 . 

A difference scheme is said to be conditionally stable when it is 
stable only if r and h are related in some way, otherwise it becomes un¬ 
conditionally stable. A scheme, stable for arbitrary values of r and h, 
is said to be absolutely stable. One can encounter schemes stable for 
sufficiently small h and r such that h < h 0 and r < r 0 . These schemes are 
not absolutely stable, but may be unconditionally stable. 

Throughout the entire chapter, a special attention is being paid to 
several types of schemes. 

1. The explicit scheme (a = 0). Condition (23) gives 0 > ~ — /i 2 (4r) -1 , 
that is, 


(25) 



1 

2 ' 


The explicit scheme is stable only under condition (25) relating the grid 
steps h and r (a conditionally stable scheme). 

2. For <7 > ~ the implicit scheme is stable for any h and r, since a > ~ > a 0 . 
Thus, the forward difference scheme (<r = 1) and the symmetric scheme 
(it = ~) are stable for any h and r, what means, by definition, their absolute 
stability. 

3. The scheme of a higher-order approximation (<7 = <7*, <7* = ~ — 
/i 2 (12r) -1 ) is absolutely stable. Indeed, for any h and r 


(T* (7q 


h 2 h 2 

12 r 4 r 



0 . 


4. Implicit schemes with 0 < a < | for a independent of 7 = r//i 2 are 
conditionally stable if one imposes the constraint 7 < (2 — 4cr) _1 . 

5. Scheme (16) with <7 = | + /i 2 ar -1 providing an approximation of 
0(h 2 +t 2 ) is stable for any h and r if a > — 4. 
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So, not only the order of approximation, but also the stability of 
scheme (16) depend on the parameter a. 

While investigating stability we dealt actually only with two time 
layers tj, tj +1 and the step r = tj +1 — tj. All the tricks and turns remain 
unchanged when the grid w T becomes non-equidistant, that is, the step 
Tj +1 = tj +1 — tj depends on the number of the layer. In this situation the 
parameter a may depend on the number j + 1 of the layer, say a = <7 J+1 , 
which serves to motivate the presence of another condition a > <t 0 j+1 = 
| — h 2 /(4Tj +1 ) in place of (23). For instance, for the scheme of accuracy 
0(h 4 + r? +1 ) we may accept ai +1 = | — h 2 /(12 Tj +1 ). The condition 
a > (T 0 J + 1 is sufficient for the stability of the scheme with weights in the 
case when the grid u> T is non-equidistant. 

5. Stability with respect to the right-hand side. As a matter of fact, if 
a > 0, condition (23) given by 


<7 > , 


= 2 


h*_ 
4 r 


is sufficient for the stability of scheme (16) with respect to the right-hand 
side as well. It is interesting to consider problem (16b) and look for its 
solution in the form 


(26) 


JV-l 

y= £ T k X W 

k = 1 


N- 1 

E t 2 , 

k = l 


by representing the right-hand side ip in terms of the eigenfunctions {X ^}: 


(27) <p= E l Pk x[k \ II A II 2 = E ‘ft- 

k—1 k=1 

Substituting (26) and (27) into (16b) and recalling that AAE') = —X k X^ k \ 
we derive the series 


N- 1 

£ { T kt (1 + <rrA k ) + \ k T k -p k } X ^ = 0, 

k -\ 


from which it follows that the expression in the curly brackets vanishes as 
far as an orthogonal system of eigenfunctions is concerned: 


T<Pk 

1 + <tt\ 


1 - (1 - <t)t\ k 
1 + err A k 


(28) T k — q k T k + 


% = 
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Putting these together with (26) we find that 


E T k 9 * T k xW + r E i +* tX X (k) - 


With the aid of the well-known triangle inequality || v + w || < || v || + || w | 
we establish 


V || < max | I E T k + max 


k I 1 + <7T A 


/ JV-1 

—A'E'pI 

k i \ k =i 


Further, let 


I y II < max I q k \ ■ || y || + max — - — || <p \ 

k k | i + crAj, | 


1 h 2 


\ j - 0 ’ 0 2 4r ’ - ' 

When this is the case, | q k I < 1, 1 + crrA k > 1 and || y || < || y || + r || ip || or 
|| +1 || < || yi ||+r || tpi ||. Summing over j 1 = 0,1,2,... ,j and exploiting 

the fact that ||j/ 0 || = 0 for the solution of problem (16b), we derive the 
estimate 

(3i) IIE +1 II< E Elk'll- 

j ‘=o 

Let us stress here that estimate (31) was obtained under condition (30). In 
subsequent reasonings we get rid of the bound a > 0 and impose then the 
constraint 


(32) a > a t 


1 1 -e 


^ 2 


0 < £ < 1 


where e — const > 0 does not depend on h and r. True, it is to be shown 
that 

\lk l<!. 1 + (TT\ k = 1 + (<7- a € )T \ k + a, t\ k 


> 1 + T K = 1 + I T K - 


(1 -e) h 2 Xk 
4 


_ {l-e)h 2 X N _ 1 __ (l-e)E _£ 

4 4 h 2 £: 
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implying that 1 + err A k > £ for all k = 1,2,. . . , N — 1 and providing in 
combination with (29) the validity of the following estimates: 

\\y\\ < II y II + r II V 5 II £_1 


and 

(33) ||^ +1 || < 7 E r||^''||. 

- j'=o 

For a = it* the condition it* < 0 ensures r < | h 2 and the value e — | 
can easily be found from the equation ^ (1 — e) = —. Collecting estimates 
(24), (31) and (33) and summarizing the preceding results, we deduce the 
following assertion. 

If the conditions a > | — jj- h? t~ 1 = u 0 and a > 0 hold simultaneously, 
then scheme (16) is stable with respect to the initial data and the right-hand 
side, so that the solution of problem (16) admits the estimate 


II!/ 


j+i 


< 


J 

■ E r 

j'=o 


When a < 0, for the stability of scheme (16) with respect to the right-hand 
side 


<7 > 


1 

2 


(1 — e) h 2 __ 


0 < e < 1, 


is a sufficient condition. Here £ £ (0, 1) is an arbitrary constant indepen¬ 
dent of h and r. For such a choice, the solution of problem (16) satisfies 
the estimate 

lli/ J+l II < IKII + ~ E r IIII ■ 

£ j'-o 


For the scheme of accuracy 0(h 4 + r 2 ) we thus have £ = I and < 7 * < 0 
if r < i/i 2 . 

6. Convergence and accuracy in the space Li 2 (w h ). We state here that the 
convergence of scheme (II) follows from its stability and approximation. 
The error z ~ y — u is just the solution of problem (III). Using a priori 
estimate (31) behind we deduce that 


(34) ||W+ 1 < E r IIE' II 

J '=0 


0 ) 


as 


<7 > < 7 , 


(7 > 0 . 
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This type of situation is covered by the following assertion. 


If scheme (II) is stable with respect to the right-hand side and 
approximates problem (I), then it converges and the order of 
accuracy coincides with the order of approximation. 


Upon substituting the estimates for the approximation error obtained 


in Section 3 into (34) we find that 




( Oih 2 + r 2 ) , 

(7=1, 

u e Cl , 


(35) || y 3 - u 3 || = < 0(h 4 + t 2 ) , 

(7 — <J* , 

■u e G|, 


( 0(h 2 + t ), 

(7^|, 

<7 ^ (7* , 

u e c\ 


So far we have investigated stability and convergence in mean, that is, in 
the grid norm of the space L 2 (u> h ). Meanwhile, many situations exist in 
which a uniform estimate, that is, an estimate for the error of a solution 
will be of practical significance with regard to the norm 


y J — u 1 |j r := max I y J — u J I . 

7. Stability and convergence in the space C. In this section we expound 
certain devices for obtaining uniform estimates for the problem (16) solu¬ 
tion: 

• the maximum principle; 

• the energy method which makes it possible to establish stability 
in the space C with respect to the right-hand side on account of 
embedding theorems; 

• the representation of a solution in integral form in terms of the grid 
function of the impulse point source (Green’s function). 

The maximum principle and, in particular, Theorem 3 in Chapter 1, 
Section 2 will be quite applicable once we rearrange problem (II) supplied 
by homogeneous boundary conditions (scheme (16)) with obvious modifi¬ 
cations and minor changes. The traditional tool for carrying out this work 
is connected with 


cr t Ay — y = — y — (1 — cr) t Ay — r ip = —F, 

y 0 = 0 , y N = 0 , 


(36) 


y° = M x i ) - 



Heat conduction equation with constant coefficients 


315 


or 


vjyii-i - (2(77 + l )Vi + cr 7%+i = ~Fi , i=l,2, ... ,N -1 

(37) Fi = (1 - <7)7 + (1 - 2(1 - (7)7) % + (1 - (7)7 y i+1 +T<pi, 


7 


fi 2 


i = 1, 2, ... ,N - 1 . 


The theorem we have mentioned above asserts that for a solution to the 
difference equation 


A% Vi- 1 C% y i + If: y,, , — Fi 


i = 1 , 2 , 


,N - 1 


y 0 = 0 

the estimate 


Vn — 0 > 


\Ai | yf 0 , | Bi | zfi 0 . 


\y\\r < 


is valid if and only if D{ — \ Ci | — | A, | — | B t | >0. For problem (36) these 
conditions (| A; | yl 0 , | | yt 0 , A' > 0 ) are satisfied for cr > 0 and A = 1 , 

so that a solution to equation (37) can be most readily evaluated as follows: 


y\\c<\\F\\ c - ~ = 


for <7 > 0 

(t/j = Fi for (7 = 0). A simple observation that 


F\\ c <\\y\\ c + r\\<p\ 


if 


1 — 2(1 — <7) 7 > 0 , 1 — <7 > 0 . 


\y j+1 lie < \\y j lie + T \\F j lie 


may be useful in the further establishment of the inequality 
(38) 

which is valid for scheme (36) under the constraint 

h 2 


(39) 


T < 


2(1-<t) ' 


Summation of (38) over j' = 0,1,2,... ,j leads to the estimate for the 
problem (16) solution 


\y 3+1 lie < IIy" 


lc + E r 11^' lie 

j'=o 


(40) 
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Summarizing, under condition (39) scheme (16) is stable with respect to 
the initial data and the right-hand side. 

Applying a priori estimate (40) to problem (III) yields 

\\ zJ+1 lie < £ r II E' || c • 

j'=0 

We give a brief survey afforded by the above results: scheme (II) converges 
uniformly with the same rate as in the grid L 2 (cv ft )-norm (see (35)) if and 
only if condition (39) holds. The stability condition (39) in the space C' 
for the explicit scheme with a = 0, namely r < |/i 2 , coincides with the 
stability condition (25) in the space L 2 (ui h ) that we have established for the 
case <7 < The forward difference scheme with a = 1 is absolutely stable 
in the space C. The symmetric difference scheme with a = | is stable in 
the space C under the constraint t < h 2 . 

8. The method of energy inequalities. The well-developed method of energy 
inequalities from Chapter 2 seems to offer more advantages in investigating 
the stability of scheme (II) with weights. 

We first illustrate its employment for a differential equation in tackling 
problem (I) with homogeneous boundary conditions 


(41) 


du 

dt 


d 2 u 

w(0, t ) = u(l, t) = 0 , 


0 < a: < 1 , 0 < t <T, 

u(x, 0) = w 0 (x’) . 


Here the inner product and associated norm are defined by 
l 

(w, v) = f w(x’) v(x) dx , || w || — \J ( u, u ) , 

o 


where u(x) and v(x) are functions defined on the segment 0 < x < 1 and 
vanishing at the points x = 0 and x = 1. Let us multiply the equation by 
du/dt and integrate it with respect to x from 0 to 1, The outcome of this 
is 


du 2 
dt 


du d 2 u 
dt ’ dx 2 


du 

dt 


Integrating the second term by parts and taking into account the equality 


du du | 1 
dt dx 


o 
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we find that 


du 

2 1 d 

1 

du 

dt 

2 dt 

dx 


du 

dt 


To majorize the right-hand side, we make use of the Cauchy-Bunyakovskii 
inequality and the e-inequality | ab \ < e a 2 + | e~ 1 b 2 with e = 1, permitting 
us to arrive at the relations 


du 

at 


< 


(f,~) 

< 

du 

■ || f || < 

du 

v ’ dt) 


dt 

1 1 J 11 — 

~dt 


2 + i ||/|| 2 , 


implying that 


d_ 

dt 


III S ill A., or 


By integrating with respect to t we thus have 


du(t) 

< 

<9«(0) 

dx 


dx 



i/2 


< 


du(0) 

dx 


T 

2~ 


max 
0 <i<T 


11/(011- 


With the aid of the relation 


|| u |L = max | u(x) \ < - 
0 0<£<1 2 


du 

dx 


we finally get 


II “Wile ^ 


1 

2 


du(0) 

dx 


1 

2 


T 

2" 


max || fit) || . 
o<t<T w 


At the next stage a similar estimate is needed in this connection for the 
difference problem (16), We proceed as usual. This amounts to introducing 
the inner products and associated norms: 


JV-l 

(y, v ) = E Vi v i h . 

i =1 


/II = V(y> y ) 


N 


{y, y}= J2vi v i h : 

i= 1 


l|y]| = \Z(y> y] 
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and taking into consideration the trivial identities 

y = \ (y + y) - | t y t , y = | (y + y) + \ry t , 

a y + (1 - cr) y - (a - \) r y t + | (y + y) . 

Putting these together with (16b) we recast the problem concerned as 

y t - Tk Vt - \ + y) = v, 

(42) 

y(x, 0) = 0 , 2/(0, t) = 2/(1, t) = 0 , 

which reduces by multiplying equation (42) by 2 ry t h = 2 (y — y) h and 
summing the resulting equality over the inner nodes x = ih of the grid to h 
to 

(43) 2r || y t || 2 - 2 (cr - \ ) r 2 (Ay t , y t ) - ( A(y + y), y- y ) = 2r{<p, y t ). 

By appeal to the Green difference formula derived in Chapter 2, Section 
3.1 

(A v, w) = (v Sx , w) = -( v s , w s } , Vq — Wq — 0 , v N = w N = 0 , 

with v — y t , w = y t and v = y+y,w = y — y incorporated, we find in view 
°f y 0 = Vn = 0 that 


( A y t , y t ) = -\\y ts }\ 2 , 

(A(y + y), y- y) = ~{y s + y s , y s - y s ] = -(|| y s }\ 2 - || y s }\ 2 ) . 

Substitution of these expressions into (43) leads to the energy identity 

(44) 2r (\\y t || 2 + (a - | )r \\y tx }\ 2 ) + \ \y s }\ 2 = ||?y s ]| 2 + 2 t (<p, y t ) , 

which is valid for any a. Let u > u 0 . The accepted view is that a reasonable 
form is 

J- IM| 2 + (>- \) T ll%]| 2 wi th v-y t . 

By virtue of the estimate emerged in Chapter 2, Section 3 


(45) 
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one succeeds in showing that J > 0 for a > <r 0 . Because of (45), 

J = \\ v t + {<t - <t 0 )t \\v t }\ 2 + (v 0 - |) r ll %]| 2 

>IMI 2 -^ 2 llrf>o 

for it > (T 0 = | — /i 2 (4 t) - 1 . Combination of the preceding relations reveals 
a profound result known as the energy inequality: 

I lie] I 2 < llfe ]| 2 + 2r (vc y t ), 


If <p = 0 and y is a solution of problem (16a), then || r/l +1 ]| < ■ • • < || ]|, 

meaning that for a > <r 0 scheme (16) is stable with respect to the initial 

0 

data in the norm || y | = 11 y s ] |, which is a grid analog of the W ./-norm. 

No doubt, it sounds interesting, but the discovery of stability with respect 
to the right-hand is of special merit in this matter. Letting 


(46) a > cr £ 
we claim that 

(47) 


1 (1 — e) h 2 


At 


J > e II v II 2 for a > a. 


0 < £ < 1 


Indeed, 


J = || v || 2 + (it - <t e ) r || ]| 2 + (cr E - 1)t\\v s 

1 2 (1 -e)/i 2 ,, , 1|2 


> «r - 


> IMI 2 -(!-£) IMI 2 = £ IM 


Substituting (47) into (44) yields the energy inequality 

(48) ‘ZT£\\y t \\ 2 +\\y s }[ 2 < || y s ]| 2 + 2 r ( 99 , y t ) , a>a € . 


By applying successively the Cauchy-BunyakovskiT inequality and the e- 
inequality we arrive at the chain of the relations 

(49) 2r(<p, y t ) < 2 r || 99 || \\y t || < 2r£ || || 2 + ^ ||v?|| 2 . 
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Substitution of (49) into (48) gives 

Il24' + 1 ]| 2 <ll24']| 2 + {- £ Ill'll 2 - 

Summing over j' — 0,1,... ,j and keeping y° = 0, we deduce that 

IIE +1 ]| 2 < E HIE'll 2 - 

l£ ji -Q 

In agreement with Lemma 1 in Chapter 2, Section 3, we might have 



%]| 


thereby justifying that 




E r HE' II 2 

j'=0 


1 1/2 


a > a c . 


Applying this estimate to problem (III) we get 


VT 


\\z 3 + 1 \\ r <M 2 max 11^ II, M 2 = , 

11 " c “ o <j'<j 11 ^ 11 ’ 2^27 

thus demonstrating that scheme (III) converges uniformly, so that 


a > a c , 


M (h 2 + r) , 

(7 > | , 

u G C 2 , 

M (h 2 + t 2 ) , 

(7 = | , 

u e C'|, 

M (h 4 + t 2 ) , 

O' — <7* , 

u G C|. 


A case in point is that for the explicit scheme with a = 0 the uniform 
convergence does not follow from (46) under the constraint r < | h 2 . But 
the a priori estimate emerged in Section 5.7, namely 


IIEIIc < 11//° lie + E r II E' lie > 

j'=o 

provides support for the view that 


T <\h, 2 


IE J+1 |lc < E r llE'lle- 

j'=o 

Whence it follows immediately that the explicit scheme converges uniformly 
with the rate 0(t + h 2 ). 
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9. The third kind boundary conditions. The first kind boundary conditions 
we have considered so far are satisfied on a grid exactly. In Chapter 2 we 
have suggested one effective method, by means of which it is possible to 
approximate the third kind boundary condition for the forward difference 
scheme (a = 1) and the explicit scheme (it = 0) and generate an approxi¬ 
mation of 0(t + h 2 ). Here we will handle scheme (II) with weights, where 
a is kept fixed. In preparation for this, the third kind boundary condition 

(50) d u(0, t) = pj(t), = const > 0 , 

will be imposed at the point x = 0, providing later the difference boundary 
condition on the four-point pattern with the nodes (0, 2 ), (h, tj + 2 ), (0, f ■) 

and (h,tj). Once supplied by the difference condition 

(51) (r(y x ~Pi j/) 0 + (l- cr ) {Vx-Pi y)o = \hy tfl ~Pi , Vi = fti + ^hfo > 

where f 0 = /(0,tj +1 / 2 ) and /}.j = we will show that it approx¬ 

imates condition (50) on a solution u = u(x,t ) to equation (3) subject to 
condition (50) and the order of approximation is the same as we obtained 
in approximating equation (3) by scheme (II) for a given value of a. 

Upon substituting y = z + u into (51) we find that 

(52) a(z x - p 1 2) Q + (l-a){z x -/?, z) 0 = \hz t>0 - fq , 

where fq = u ( u x — /3 t u) 0 + (1 — a) (u x — P 1 u) 0 — | h u t 0 + jl 1 is the error 

of approximation of condition (50) by the difference condition (51) on a 

solution u. Developing Taylor’s series for u about the node (0, tj + | r) 
and denoting by v 0 the value of the function v at this node, we can write 
down in the preceding notations u' = du/dx and u = du/dt 

i'l = K - Pi «o + Ui)o + - y ) T («■' - Pi «)o 

r | h u 0 + | h u" + 0{h 2 + r 2 ) . 

Inserting here u' — /?j u 0 — and tl" = u 0 — f 0 both recovered from the 
equation 

i'l = (c - 5 ) t (w'o “ Pi «o) + 0( h ‘ 2 + t2 ) > 

we deduce that 


fq = 0{ h 2 + r), cr 7 ^ | , 

£q = 0(h 2 + r 2 ) , cr = |. 


(53) 
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It is straightforward to verify that at the point x = 1 the boundary condi¬ 
tion 

(54) -=/3 2 w(l, t) - ^i 2 (t), /? 2 = const > 0 , 

is approximated to the same order by the difference condition 

(55) ~[a( y s + P 2 y) N + (1 - cr)(y s + P 2 y) N ] = \hy t<N - p 2 , 


where p 2 = Ji 2 + \ hf N , Ji 2 = p 2 {t j+1/2 ) and f N = /(M j+1/2 ). By setting 


h 2 T h 2 - h 2 

— aa + y A*i + y (/o _ A W + y fi % i 

h 2 h 2 - - /i 2 

AT = AT + y A* 2 ~ -y (/(v + P 2 In) + y Ah V’/v i 


( P = f + 


fP 

12 




and replacing ^hy t0 and \hy tN in (51) and (55) by ~ h p 1 y t 0 and 
\hp 2 y t N) respectively, with p k = 1 + \ h(3 k , k = 1,2, we establish the 
difference boundary conditions providing an approximation of 0(h 4 + r 2 ) 
for <7 = < 7 * = | — J~ h 2 t~ 1 . 

To avoid cumbersome calculations, it will be sensible to introduce 
more compact notations 


A y 


Vx ~ Pi V 


A+y = 


Vs + P 2 y 

\ h 


and rewrite the difference boundary conditions (51) and (55) in the same 
forms as approved before for scheme (II): 


(56) 


Vt -A (ay+(l-a)y)+<p , x = 0, 

y t = A + (cry + (1 - cr)y) + <p+, x-l, 


with <p~ = 2fi 1 /h and ip + = 2 ft 2 //i, showing the new notations to be 
sensible ones. For /?j = /? 2 = 0 these can be viewed as the difference 
approximations of the second kind boundary conditions. Also, the order of 
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approximation happens to be the same as we obtained for the boundary- 
value problem of the third kind. 

Let us reduce condition (51) to an alternative form convenient for 
current manipulations. The outcome of solving (51) with respect to y 0 = 

J / 0 J+1 is 


(57) 


y 0 = *5 Vi + "i , x i = ~T~ > A, rr <7 (l + j3 i h) + , 

Za j 2j T 


A = ^-{(1t)!/i + — (1 — <x) (1 + /?, /^) 

Along these lines, condition (55) becomes 


Vo + hP-i f ■ 


(58) 


a . h 2 

2/tv = Vn-i + > ^2 = , A 2 = cr (1 + /? 2 h) + — , 

'A = |(1 — a ) Vn-i + — - (1 - cr) (1 + P 2 h) y N + hfi 2 | , 


so that 0 < x a < 1 for @ a > 0, a > 0 and a = 1,2. In the determination 
of y on a new layer we obtain the difference equation (8) with boundary 
conditions (57)—(58). This problem can be solved by the right elimination 
method (see Chapter 1, Section 2.5). 

Stability of scheme (II) with the third kind boundary conditions can be 
discovered following established practice either by the method of separation 
of variables or on account of the maximum principle. 

10. Three-layer schemes for the heat conduction equation. One of the 

first schemes arising in numerical solution of the heat conduction equation 
du/dt = d 2 u/dx 2 was the Richardson explicit three-layer scheme such as 


yi+ 1 - yj - 1 

(59) --- = A y 3 or t/= = Ay, 

at t 

where 


y _ y 

y° = —, y = y J+1 , y = y ] ~ l , y = y 3 , Ay = y sx . 

t l T 

By exactly the same reasoning as before, it is not difficult to verify that this 
scheme is of order 2 with respect to r and h both: (i = Aa-iio = 0(/i 2 +r 2 ). 
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But it is absolutely unstable: this scheme becomes unstable for any way of 
tending r and h to zero. 

As further developments occur, we rewrite equation (59) as 


(60) 


/ +1 - yj 1 _ vLi - +y / +1 

2 r h 2 


Upon substituting the sum yp +i + r//” 1 for 2 y? in the right-hand side of 
equation (60) the resulting three-layer “rhombus” scheme known as the 

Du-Fort—Frankel scheme 


(61) 


,i+i 


Vi-i 


Vi 


i+i 


' Vi +1 


2 r 


/i 2 


becomes explicit with respect to t// +1 and appears to be absolutely stable 
for any h and r. In giving an alternative form of the “rhombus” scheme 

T 2 

(62) yo + — y n = A y 

with y^ t — ( y- +i — 2 y- + y/” 1 ) t - ” 2 we may attempt the right-hand side 
of equation (61) in the form 

Vi -1 -y, + Vi +1 = y»-i - + y»+i _ k - 2 y { + ^ 

/i 2 /i 2 /i 2 

T 2 

^27.7; ■ 

Substitution of the last expression into (61) yields (62). As a matter of fact, 
the “rhombus” scheme is some modification of the Richardson scheme with 
the extra member on the left-hand side of (61) t 1 h~ 2 y^ t , which assures 
us of its stability. The proof of stability of scheme (62) is an immediate 
implication of the 'general theory of Chapter 6 and is omitted here. The 
error of approximation for scheme (62) is 

2 2 2 

ip = Au-Uo - T —t: u lt = u"-ii- ^7 u + 0(h 2 + t 2 ) = - 1 — il + 0(h 2 + T 2 ) . 
t /A /A /A 

From such reasoning it seems clear that the “rhombus” scheme provides 
the conditional approximation 


■ip = 0 (t 2 + h 2 + t 2 h 2 ) = 0(h 2 ) as r = 0(h 2 ). 
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Keeping r = ah (l + 0(h )) with a = const we draw the conclusion that 
scheme (62) approximates any equation of the form 

du 2 d 2 u d 2 u 

dt dt 2 dx 2 

The following implicit three-layer schemes with weights are quite applicable 
in solving equation (3): 

• symmetric schemes 

(63) j/o = A(ay + (1 - 2a)y + a y) + (p; 

• nonsymmetric schemes 

(64) y t +a ry u = Ay + tp . 

Equations (63) and (64) contain the three layers (tj_ 1} tj, t J+1 ), so that, in 
what follows, tj > r, j > 1. The value y(x, 0) = u Q (x) is known in advance 
and the value y(x,r) should be preassigned in addition to the available 
information. For example, this value can be determined either by 

y t (x, 0) = ii 0 (x) or y(x, r) = y(x, 0) + r u 0 (x) 

with u 0 (x) = u"(x) + f(x, 0) still subject to the condition y(x, t) — u(x, t) = 
0(t 2 ) (see Chapter 2, Section 1). 

Sometimes two-layer schemes are effectively used to assign the value 
y(x, t). 

By virtue of the asymptotic relation 

<twT(1 — 2 a) u + a ii = u + a t 2 uj t = u + 0(r 2 ) 

the symmetric scheme (63) is of order 2 in r and h for any a. The error of 
approximation for scheme (64) is representable by 

(65) ip = Ait + <p — (u t + a t u^) 

= L it-\- tp — (it — | r it + a t ii) + 0(h 2 + r 2 ) 

= (Lu + f-u)+(tp-f)-(o--^) TU + 0(h 2 + r 2 ), 

which serves to motivate the accuracies which interest us in the following 
cases: 


ip = 0(h 2 + r 2 ) 

for a = | , 

l P = f, 

ip = 0(h 2 + t ) 

for a ^ | , 

<P = f■ 
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Omitting the terms 0(h 2 ) in (65) and involving the equation u — u" + f 
insight, we deduce that scheme (64) provides an approximation of 0(/i 4 +r 2 ) 
with the members 

a = i + l2 h2 T ~ 1 < <? = /+(/" + /) • 

In trying to recover y from (63)—(64) we obtain the three-point equations 
(66) A %_j - C Vi + B y i+1 = - F{ 

with the right-hand sides —F, depending on y, y, <p and the usual boundary 
conditions for i = 0 and i = N. This problem can be solved by the right 
elimination method. In the process of computing the values of y and y on 
two previous layers should be placed in the storage. In the case of two-layer 
schemes it suffices to save merely one preceding layer. 

Stability of three-layer schemes will be established in Chapter 6. For 
the purposes of current section we confine ourselves to sufficient stability 
conditions for the symmetric scheme (63) and scheme (64), respectively: 
(7 > i and it > — In just the same way as we did for two-layer schemes 
the difference boundary conditions with a highly accurate approximation 
can be developed for the third kind boundary conditions (50) and (54). For 
the symmetric scheme (63) the boundary conditions providing an approxi¬ 
mation of 0(h 2 + r 2 ) reduce to 

y a - A~(ay+(l-2a)y+ay) +ip~, i = 0, 

ijo = A+( ay + (1 - 2(7) y + cry) + <p + , i = N, 

with 


A y- 


Vx 



A+t 


y s + h y 


\ h 




m t) 




<p + — /(i) 0 + 


tc 00 

\ h 


showing the new notations to be sensible ones. 

On the same grounds as before, the third kind difference boundary 
conditions for the nonsymmetric scheme (64) are specified by the relations 


i= 0, 


(67) 


Pi (Vt + VTy u ) = A y + ^ , 

P2 ( y t + ° T yu) = A+t/ + v?+, 


i = N . 
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These boundary conditions generate an approximation of 0(/i 2 + r) for any 
a if we agree to consider p x = p 2 = 1 and 


¥ 


— /(0, t + t) + 


Pi (t + t) 
0.5 h 


¥ 


/(l) t + t) + 


P 2 (t + r ) 

0.5 h 


But the same procedure works for cr = | and the boundary conditions (67), 
making it possible to achieve 0{h 2 + r 2 ). Eventually, by successive use of 
the members 


1 /t 2 

a - 2 + Y2 ~t' 3 




P 2 — 1 + 


h P 2 

3 ’ 


9? = V? + 


0.5/1 ’ 


1 7^2 

V 5 = P2 V 5 + 


0.5/i ’ 


p = f(x, t + r) + — (/"(*. t + r ) + /(*, t + r)) , 


,y i — Pi (t + r ) + (Ai(/ + r ) + /'(0, t + t) — PJ(0, t + r)) , 


P 2 (t + t) + — (p 2 (t + r) - /'(l, t + r)- /? 2 /( 1 , t + t)) 


we arrive at scheme (64) of accuracy 0{h A + r 2 ) and the error of approxi¬ 
mation 0((h 4 + r 2 )//i) at the nodes x = 0 and x = 1. 


5.2 ASYMPTOTIC STABILITY 

1. p-stability. In studying various schemes for the heat conduction equa¬ 
tion we have already mentioned that the simplest way of relaxation of the 
stability condition connected with upper bounds on the step in time r is 
the transition to implicit schemes. All of the implicit schemes with a weight 
of the upper layer <7 > <r 0 , c 0 = | /i 2 r -1 , are stable. In particular, the 

schemes with <7 = | and (7=1 are absolutely stable, At the final stage 
of research the scientists are interested in the accuracy with which an ap¬ 
proximate solution to a differential equation could be found. It is natural 
to try to reach a prescribed accuracy by carrying out the minimal possi¬ 
ble number of computer operations (arithmetic and logic), that is, with 
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the minimal expenses of execution time. A number of operations may be 
minimized by improvements of difference schemes as a result of modeling 
the basic properties of a differential equation in the space of grid functions 
as well as possible. One of such typical properties is the true asymptotic 
behavior of its solution as t —+ oo. 

To illustrate our approach, let us consider, for example, the heat con¬ 
duction equation 

t> 0 , 

«(1, t) = 0 , t > 0 . 

The problem concerned can be solved by the method of separation of vari¬ 
ables, within the framework of which we seek its solution as a sum 

OO 

■u(x, t) = c k e_Afc< X k {x) , X k {x) = \/2 sin nkx , 

k = l 


( 1 ) 


du 

dt 


d 2 u 
dx 2 


, 0 ) 


0 < x < 1, 

0 < X < 1 , «( 0 , t ) : 


where 


l 

X k = k 2 7r 2 , c k = (u 0 , X k ) = f u 0 (x)X k (x) dx, 

0 

CO oo 

IK*. Oil 2 = E c l e- 2X k f \\X k || 2 = c\e- 2 ^, 

k = 1 k = 1 

since \\X k || = 1. As X k increases along with the subscript k, we thus have 
X k > Aj and 

OO 

\\u(t)\\ 2 <e~ 2 ^ E cl = e~ 2 X t || Uo ||2, 

k = 1 

which means that the solution of problem (1) admits the estimate 

(2) UK) IK e~ Al ( || «(0) || for any t> 0. 

With increasing t the harmonics u^ = c k e~ x k t X k (x), k > 1, damp 
more rapidly than the first one, so that for sufficiently large t 

(3) u(x,t) « Cj e~ A i i Xi(x ), 


b/ 0 ■ 
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This stage of the process refers to the regular behavior. When the so¬ 
lution of a difference scheme for problem (1) also possesses the properties 
similar to (2) and (3), the scheme is said to be asymptotically stable. 
We now deal with the scheme with weights 


Vt = A (ay+ (1 - a)y) , xeui h , t = jr> 0, 

( 4 ) y 0 = yN = Q > y(x, o) = u 0 (x), 

A y = y tx . 

The solution of the problem under consideration has been obtained in Sec¬ 
tion 1.4 by the method of separation of variables and can be expressed by 
the following series 


JV-l 


yi = y( x r ’ t j)= E °k E x k (xi ), 

k- 1 


where 


1 - (1 - <t)tX l 
l + urAj 




4 

Y 


. , 7 rhk 

sin ~Y~ ’ 


Xk{x{) = V2 sin irkx i , 


Ck 


( u o,Xk) 


(y> 


N-l 

E yi v ih. 


The orthonormality of the system {X k } gives 


jV-1 JV-1 

i j II 2 = E 4 $ < Y E c 2 


k = 1 


k = i 


h - p 2] IIj/° II 2 - 


which assures us of the validity of the estimate 


( 5 ) 


IE II < p j IIE 


p = max q i. 

lCfcCJV-l 


Scheme (4) is said to be p-stable with respect to the initial data if estimate 
(5) is valid. An estimate of the form (3) is admissible for the solution of 
problem (4) when p < 1. 
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2. Asymptotic stability. Let us describe rather mild conditions under which 
the behavior of the solution y 3 of the difference problem (4) becomes regular 
if one makes f ■ — jr large enough: 


( 6 ) 


y/ = y(*i ,tj)~ c i X i( x i) ■ 


Clearly, it is possible only in the case when the first harmonic dominates, 
that is, max | q k | is attained for k — 1, so that 


(?) 


max 

l<fc<JV-l 


% 


P = 


1 - (1 - cr)r A* 
1 + a t AJ* 


What is available to find out the conditions ensuring the validity of formula 
(7) is the function 


Up) = 


i - (i - <t) \ 2 

l + ^i ) 


1 - (1 - a)fi \ 2 

1 + crp ) 


where ftj = r Aj* and fi = t A* > ji l under the natural premise /(ft) > 0, 
ft > fi, 1 , Alternative forms of the function /(ft) may be chosen in a number 
of different ways. In subsequent reasonings we prefer one of them: 


fip) = fiip)f 2 iP) K 1 > A'= (1 + (TflJ 2 (1 + (Tfl) 2 > 0, 

fi(p) = (1 - (1 - e)Pi ) (1 + <7fi) - (1 - (1 - cr)fi) (1 + a^) 


P - Pi > 0 , 


fnip) = i 1 - (! - a )Pi ) (1 + o- fi) + (i - (i - a) fi) ( 1 + crfij ) 

—- 2 -(- (2(j 1 ) (ft ~b Pi) 2(1 (j)(T ft ft^ , 

implying for r < f 0 that 

f2 + ft + ftj>0 ifcr=l, 

,2 ^ [2— (fi + fij)>2-r(A + (5)>0 if <7 = 0, 


where r 0 = 2 (6 + A) 1 , S = Aj* and A = A^_ . In particular, we have 


f 2 ip) = 2 - \pPi> 2 ~\ Pn-i Pi = 2— |r 2 A(5>0 
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for the symmetric scheme with a — | under the constraint r < 2 (6 A) l ! 2 . 
We bring together the results obtained and state that 


1 




1 + t 6 
1 - t5 
i 


for a = 1 and any r > 0 , 


1 - 2 tS 
1 + \t8 


for (7 = 0 and r < r n 


for <7=;| and r < r 0 


<S + A ’ 

2 

AA ' 


In each such case the estimate || y 3 || < p 3 || y° || is certainly true. Moreover, 
p 3 —> 0 occurs as tj =■ j r —+ oo. As we will see a little later, it will be 
convenient to represent p by 

p = e~^+ TV , t ip — p x — log — , p x = t 6 . 


It is straightforward to verify that for a = | 


1 + \ Pi 

T<f= p x — log --j- 


1 - 2 Pi 

It follows from the foregoing that 


d.d 

12 80 


6 3 t 4 S 5 


12 80 


p 3 = exp < — St 


12 80 


t 3 > < e J. 


The regular behavior for the symmetric scheme with a = | can be 
described as follows: 

, y(Xi, tj) ~ c l e- Si j +pt ^X 1 (x i ), 

where 

r 2 <5 3 r 4 <5 5 


A 


0(7 


12 80 

In dealing with the pure implicit scheme we might have 

1 


6 = A". 


P 


1 + tS 


> e 


-t6 


j —5 tj +/? tj 

p J — e 3 H 3 
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with the asymptotic expansion /? = | r 8 2 — | r 2 S 3 + ■■■ = 0(r). It 
is evident that pi approximates e~ St i poorly as compared with another 
scheme we have mentioned above. 

Our approach is especially clear in the forthcoming example with 

T = T ° = 7 fz ’ 

For the value 8 / A = 0.01 the quantities 

pUo.s = a>.5 = YJ = °' 8182 ’ /’Ur = Pl = ~h = °' 8333 

need to be considered with more care than usual. Their comparison with 
e~ Tb = e~ 0 - 2 = 0.8187 gives 



p o s = (1 - 0.0006) e~ T \ Pl =( 1 + 0.018) e~ T6 . 


To be more specific, for 8 = 1 (j = 5) we have 


P 


j 

0.5 


0.997 e~ b , 


1.0 9e~ 6t j, 


thereby clarifying that for 8tj = 1 the quantity pi s differs from e 6t i by 
0.3% and pi - by 9%. 

The above example shows that although the scheme with a = 1 is 
absolutely stable and, in principle, may be used for any r, it is not accurate 
enough at the stage of the regular behavior when r grows. In order to retain 
a prescribed accuracy (here it is meaninful to speak only about the relative 
accuracy), we should refine successively the step r = Tj with increasing tj. 
So, we are much disappointed by the main advantage of the scheme with 
a = 1 stipulated by its stability for any r > 0. 

The symmetric scheme with a = which is absolutely stable in 
the usual sense: || yi || < 11 y° ||, is conditionally asymptotically stable for 
r < r 0 . Being concerned with the explicit scheme for a = 0, we observe that 
the condition of asymptotic stability r < 2 (<5 + A) -1 practically coincides 
with the usual stability condition r < 2 A -1 for small values of 8/ A. 

For the heat conduction equation 


<5 



7T h 

T 


A = 


h 2 


7T h 


8 +A 


4 
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and the stability condition r < h 2 /2 also implies that r < 2 (6 + A) 1 . In 
the case of a symmetric scheme 


2 _ h 2 _ h 

\/8 A sin 7 rh 7r 


and the condition r < h/ir is not burdensome. Thus emerged the typical 
relation 7 = t/ h 2 < 1/ ( 7 r/i), so that 7 < 10 / 7 r for h — 0.1 and 7 < 100 / 7 T for 
h = 0.01. The first eigenvalue A ^ 1 = 6 of the difference problem concerned 


is 


sin £ 

~r 




where £ = irh/2. Plain calculations show that 


f 0.97 Aj for h = 0.1, 

| 0.9997 Aj for h = 0.01, 


It is interesting to learn what may happen in dealing with the symmetric 
scheme with a = \ and one of the possible steps r > r 0 , say r = mr 0 , 
m > 1? Then max* | q k | is attained for k = N — 1: 


P= \ 


A—1 1 — 2 r _i A _i 

\t A + 1 ~ l + 2r-‘ A - 1 


Upon substituting here 


1 

r A 


1 

m r 0 A 



<5 2 _ 6 t 0 _ t6 

4 m \/s~A 4 m 4 m 2 


we get p = e 7 S+T 7 ’ ^ with 

,? = 0(rS) - 

Thus, in the symmetric scheme with a = 4 the improper asymptotics is 
revealed for m > 1 : 


f <5 
\ 4 m 2 




J/(»i > ~ Cyv -1 exp 
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where 


= sin 7 t(TV — 1) x ; = sin tt(N — 1) ih 
= sin 7r(l — h) i = (— l) !_i sin irx i 

= (-ir i x 1 (x l ), 


so that 


y(x { , tj) « c N __j exp 


6 

4 m 2 7 




X 1 (Ej) = sin 7T . 


This provides support for the view that the solution is completely dis¬ 
torted. From such reasoning it seems clear that asymptotic stability of a 
given scheme is intimately connected with its accuracy. When asymptotic 
stability is disturbed, accuracy losses may occur for large values of time. 
On the other hand, the forward difference scheme with a = 1 is asymp¬ 
totically stable for any r and its accuracy becomes worse with increasing 
tj, because its order in t is equal to 1. In practical implementations the 
further retention of a prescribed accuracy is possible to the same value for 
which the explicit scheme is applicable. Hence, it is not expedient to use 
the forward difference scheme for solving problem (1) on the large time 
intervals. 

3. The scheme of second-order accuracy (unconditionally stable in the as¬ 
ymptotic sense). Before taking up the general case, our starting point is 
the existing scheme of order 2 for the heat conduction equation possessing 
the unconditional asymptotic stability and having the form 


( 8 ) 


(E -\<ttK) 


yj +1 l 2 — yi 




J/7 + 1 _ J/7+ 1 / 2 

y - - y - - = i <7A yi+\ 


where A y = y Sxl E is the identity operator, j/f+F 2 i s the intermediate 
value and <7 = 2 — y/2. For i = 0 and i = N the homogeneous boundary 
conditions are specified by 

t / 0 7+1/2 = Vn +112 = 0 - Vo =Vn = 0 • 


( 9 ) 
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The usual trick amounts to eliminating y3 +1 l 2 from (8) so as to reduce the 
governing difference equations to the following ones: 

(^E - °y y j+1/2 = (E + r (1 - a) A) y j , 


E - — A ) y j+1 = y i+Jl2 . 


As a corollary to this fact, we see that 

( 10 ) 


E - — A ) y j+1 =(E+ t (1 - a) A) yA 


Having substituted into (10) the identity of artificial character 


7/ flu 7 , j 

7+1 7 i y y 

y 3 = r + t - 


or y = y + t y t , we recast the scheme at hand as 


(ii) ( E - °y A ) y t = ( A + ) y- 


The accurate account of the approximation error of scheme (11) on a 
solution u = u(x , t) to equation (1) can be done using 

cr 2 t a 2 t 2 

(12) ip = Au — —j— A 2 u — u t + a t A u t — —-— A 2 u t . 

Upon substituting into (12) the expansions 


it + u 't u t t du n 

”= -2--V = S -2 « +0(T ' ) ' 


h 2 

A« = Iii + — L 2 u+ 0(h 4 ) , 

A 2 u = A(Art) = A(Lu+^L 2 u(Z,t)\=A( d ^+^ d ^(P,t) 


L 2 u + 0(h 2 ), 
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where 


L u 


we find that 


d 2 u 

dx 2 


du 

dt 


u = u 


t - t 7+l/2 ’ 


ip = Lu 


du 

dt 


T 



1 

2 


2 u + 0(h 2 + r 2 ) . 


Hence, ip = 0(h 2 + r 2 ) for cr = 2 — a/ 2> satisfying the equation ^ <7 2 — cr+f = 
0. Other ideas are connected with the method of separation of variables, 
whose use permits us to look for a solution to equation (10) with zero 
boundary conditions y 0 = y N = 0 as a sum 

N -1 

yj _ T k Xk(x). Xk(x) - \f2 sin 7 rkx . 

k = i 


By inserting this expression in (10) we obtain the equation related to T£ : 
(1 + l 2 ^\l) 2 T^ +l — (1 — (1 ~ cr) r ) TjP 


or, what amounts to the same, T£ +1 — q k T k , where 


( h 


1 - (1 - 


1 + 1 2*r\ h k 


Furthermore, adopting arguments similar to those being used for the scheme 
with weights we arrive at the chain of the inequalities 


i j+1 !! < 


s p \\y 


j II < ••• < p j+1 II v° 


with p = maxfc | q k |, In the further analysis we shall need yet, among other 
things, the formula 

1 - (1 - °) 

P — - 0 > 

(l + | cr t h'j 

where A) 1 = 4 h~ 2 sin 2 (-7r/i/2). In giving it we will show that max* \ q k \ is 
attained for k — 1. With this aim, we have occasion to use the function 


fid) 


(* + \ a d) 
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for which 


I /(b) I - /(a*i ) < 0 for b > bi if Ah < 1 • 


It is necessary to consider merely the case (1— a) fx > 1, since otherwise 
| f{n) | = /(/z) < /(/ij) for fi > fx 1 . In that case the difference in question 
becomes 


/Ob) “ I/(b) I 


1 - (1 - a-)n l _ (1 - <r)/z - 1 

{2 + (2(7- l)//j + ^ o-Vi 


((1 ~ 2<r) + 2 o-(l - i o- 2 (1 - cr) ) 


+ \ 0-2 (f - (f - °0bi) b 2 } , 


where D = ^1 + | c7/zj ^1 + / <t n 1 J . 

Recalling that <7 = 2 — a/2, c 2 = 4 <7 — 2 and /Zj < 1 we get the 
lower estimate which will be the subject of special investigations in the 
near future: 


/(b 1 ) - I/(b) I 

> ^ {2 - ( 2 <t (1 — < t ) + | o- 2 (1 - ( t ) - (2d - 1)) /z + ^ o- 3 b 2 } 

= — {2 — (6.5 — 10.5 <7) /z + (3.5 <7 — 2)/.t 2 } . 

The square trinomial in the curly brackets equals 0.05 fi 2 — 0.349 /z + 2 and 
has the negative discriminant d = 0.349 2 — 0.402 < 0. Because of this, we 
deduce that f(fi 1 ) — \ /(/z) | > 0, meaning 

1 — (1 — cr) /Zj 1 — (1 — cr) r <5 

(l + ^bi) (f + l 0 ’ 1 '' 5 ) 


under the constraint = r <5 < 1, which is valid if being replaced by the 
condition t\ 1 =tt: 2 <\. 
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With this relation in view, it is not difficult to derive the asymptotic 
expansion 


log S+ ~ 


with the members 


-r «5 + r p 


2 A3 


t 2 6 


r 3 


24.6 271.7 


which serve to motivate the double inequality pi < e -l5 h+dh < e~ Stj 
and the a priori estimate J| yi || < e~ Stj || y° || for scheme (8) under the 
constraint r 6 < 1. 

4. Asymptotic stability of the three-layer scheme. The object of investi¬ 
gation here is the three-layer scheme 


(13) Zy t -ly i + Ay=Q, A = A*, A>6E, 6>0, 

which is unconditionally asymptotically stable for r < 1/(26). To make 
sure of it, an alternative form t/o + r y^ t + Ay = 0, which provides an 
approximation of order 2 for the heat conduction equation with constant 
coefficients (1), will appear in the further development: 

ip = Uo + Titf t + Au = Uo + t Uf t — A u — t A Uo — ~ r 2 A up 

= it + Tu — Lu — t Lit — ^ t 2 Lu + 0(h 2 + r 2 ) 

= (w — Lu) + t (it — L ii) + 0(h 2 + t 2 ) = 0(h 2 + t' 2 ) . 


Here we used also the initial equation u = Lu and its corollary il ~ Lu. 
In conformity with the method of separation of variables, 

yi = Tk(tj) Xk , 


where Xk refers to an eigenfunction of the operator A. Recall that, by 
definition, 

AX k = \ h k X k , k = l,2,...,N, 

With this in mind, we initiate the derivation of the difference equation 


3 q~* 
2 1 k 


7+1 


2 n 


n 


_1 + A l 


T, 


7+1 
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(3 + 2rA^)T/ +1 -4^+T/- 1 =0, 

whose solution is sought in the form T k = q k . Omitting the subscript k for 
a while, we investigate the quadratic equation related to q k : 


(3 + 2//)g 2 — 4g+l = 0, 


k 


— T A . 


with discriminant D = 4(1 — 2//). For D < 0 its roots q 1 - 1,2 ) are complex- 
conjugate and glOg( 2 ) = | q | 2 = (3 + 2qi )~ 1 , that is, 


(1,2), 

17. 

i _ i 

1 

<+" — 

(, + 2 ) 


^3 + 2 r A a 

a/ 3 + 2 r Aj 



Let now D > 0. In that case 


? (1 ' 2)= ? (2) >°> g (2) = 2 3 A f^ < 1 - 


A new function 

+(+) : 

with the derivative 

1 dip 


2 + a/1 — 2 qt 
3 + 2 qi 


kl <k<kN 


< 0 


tp dqi (2 + a/1 - 2qi) /l 2// 3 + 2// 

is aimed at establishing that [g^ | < | g^ | for / > fc 2 . Hence, max </>(//) 

is attained for qt = qt 1 = rAj, giving 


;ij </J</Jyv 


max +(//) = +(/+) = 2+ „ A { 1 9 if 1-2//! >0. 

/“i f+5+iV 4 + 2/+ 

It may happen that | Dk = 1 — 2 qi k < 0 for some k > 1, thus causing the 
occurrence of the event that 


Ik 


( 1 . 2)[2 _ 


3 + 2 qi k 

Since (3 + 2qi k )~ 1 < p 2 (qi 1 ), the maximum value max I g/ 2 ' l |, which can 

k 

always be attainable for k = 1, is equal to 

_ 2 + y /1 — 2 qi 1 1 

9 ~ 3 + 2 //j 1 9l 2 
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For large j the first harmonic y 3 k, a 1 p 3 dominates in the solution 


y ] = N t L U k ( q ^y+p k (A 2 ) y) x ^ 

k = 1 v ' 


which has been constructed before. 

By means of the quantity pi = e~i lo s( 1 /' 3 ) with 


1 


Hi 


3 1 + VI - 2/ij 


1 + | Hi 


it is plain to calculate 


log - = log ( 1 + ~ p , 1 ) - log (1 - 


Hi 


3 1 + y/1 — 2/ij 

The expansion in powers of /r 1 yields log (1/p) = + ~ + 


p 3 — exp <{ — 6 tj — | r 




, so that 


Thus, the three-layer scheme (13) of accuracy 0(h 2 + r 2 ) possesses the 
proper asymptotics as tj —> oo under the unique restriction r 6 < 1/2, 
which is not burdensome. Comparison of the final results with the two- 
layer scheme (4) reveals some formal advantage of the three-layer scheme 
over the symmetric two-layer scheme with a = which is conditionally 
asymptotically stable if we imposed the extra constraint r < r 0 = 1 j\Jb A, 
r 0 = T 0 (h ), in addition to the usual one r <5 < 1. However, this restriction 
is sufficiently weak in real-life situations and, therefore, it is meaningless 
to speak about any practical advantage of the three-layer scheme. For 
this reason the two-layer scheme is quite applicable and more efficient in 
practical implementations. 


5.3 SCHEMES FOR THE HEAT CONDUCTION EQUATION 
WITH SEVERAL SPATIAL VARIABLES 

1. The explicit difference scheme. The schemes considered in Section 1 
ma}' be generalized to the case of the heat conduction equation with several 
spatial variables. 
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In a common setting, let G — G + T be a p-dimensional domain with 
the boundary T and let x = (aq, x 2 , . . ., x p ) denote an arbitrary point in 
it. It is required to find in the cylinder Q T = Gx[0<i<T]a continuous 
function u(x,t), x E G, satisfying the governing equation 

du 

(1) ^ = Atif/(x, i), xEG, t> 0, 

and the supplementary conditions 

u(x, 0) = « 0 (x) , x E G , u(x, t) — fi{x ) t) , x £ T , t > 0 , 


where 


p n2 

E U 'll 

dG 


a — 1 


is the well-known Laplace operator. 

For the purposes of the present section, let us introduce the grid ui h = 
{ aq E G} in G and denote by y h the set of all nodes of Cu h belonging to 
T and by uj h the set of all inner nodes aq E G, so that ui h = ui h + j h . 
The starting point in the further development of the difference scheme is 
the approximation of the elliptic operator Am. We learn from Section 1 of 
Chapter 4 that at all of the inner nodes A u ~ A u for x £ 

By inserting in (1) the difference operator A in place of the Laplace 
operator we are led to the system of differential-difference equations 


(2) — = A v + <p(x,t), x £ Lo h , 

where v(x,t) is defined on the grid ui h for every t > 0. The size of the 
system (2) is equal to the total number of the inner nodes N of the grid 
uj h . Here the function ip(x.,t) approximates f(x,t) on the grid ui h . 

At the next stage we introduce the grid in t 


Ur = {tj = j r, j = 0,1,2,... , j 0 , j 0 T = T) 


with step r. In order to pass to the difference scheme for a new function 
y(x,t) defined on the grid ui hr — ui h x ui r = {(aq-, tj) , x E u h , t E A3 r }, 
it is necessary to replace the system of differential equations (2) by some 
difference scheme written in terms of t. Choosing, for instance, Euler’s 
scheme we obtain the explicit scheme 


yj+l _ yj 


Ay J + , 


j= 0, 1, 2, ... 


(3) 

y° = 2/(x, 0) = W 0 (x), y 3 \ =n 3 , j = 0,1,2,... 
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The value y 3+1 on the relevant layer is to be determined by the recursion 
y j+1 = y j +T (A y j + ip j ) , j = 0, 1, ... . 

For the sake of simplicity we are working in a parallelepiped G such 
that { 0 < x a < l a , a = 1,2,. .. , p } and on a certain grid ui h = { = 

(ij hj ,. . . ,i h p ), i a = 0,1,... , N a> h a = l a N ~ x } equidistant in each of 
the directions x a . We refer to the (2 p+ l)-point operator A of second-order 
approximation with the values 


(4) Ay 


P 

E A »y, 


a = 1 


A„ y — y f 


E 1 ”) -2y + y ( -~ 1 ^ 


where y is the value of the function j/(x,t) at a fixed node x = (jj h 1} . . ., 

ip h P )' y(±la) = x(±1 “ } = (h h i, • ••>*«-! h a-l, (*« ± l ) h a, 

i a+ j h a+1 , ... ,i p h p ) is the node adjacent to x (xt +1 “) stands on the right 


from x and x( lo, t stands on the left from x). With the aid of the well- 
established relations 


Au = Au+J 2 ^Llu + 0( |h| 4 ), 




L„ u = 


dh 


dx 2 ’ 

a 

we calculate the residual 


\h\ 2 = h 2 + h 2 2 + ■■■+h 2 


'll 3 ~ I - ^ 4 / •? 

V’ = A u 7 + <^> 7 -= 0(|h|“ + r) 


provided the asymptotic expansion <E = /(x, ) + 0 ( | h | 2 + r ) holds. 

Scheme (3) is conditionally stable in the space C with respect to the 
initial data, the right-hand side and the boundary data. The maximum 
principle for the difference problem (3) may be of help in establishing the 
indicated properties with further reference to the canonical form 


e +1 = f 1 - 2 E /^) y j 

^ az= I « ' 

+ XI (y 3 ( x(+Iq,) ) + E ( x( ~ Iq,) )) + t( p 3 ■ 

a -1 / 


( 5 ) 
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Comparison with the general difference equation 

(6) A(P)y(P) = J2 B(P,Q)y(Q) + F(P), 

QePatt'(P) 

which has been considered in Section 2 of Chapter 4, shows that in the case 
of interest 


P = (x,t j+1 ), Q = (x,tj) } (V+ 1 "), tjj, (V tjj, a = 1,2,... ,p , 

A(P)= 1, B(P,Q) = 1-2 J2 -P . 

a= 1 « 

The boundary 7 of the grid ui for equation (5) consists of the nodes (x, 0), 
x £ and (x,tj'), x £ 7 />, tj' < tj +1 . It is straightforward to check that 

D(P) = A(P) — B(P,Q) = 0, B(P, Q) >0 

QePatt'lP) 


if 


( 7 ) 

a=l « 

Common practice involves the decomposition for the solution of the problem 
concerned as a sum y = y + y, where y is a solution to the homogeneous 
equation 


y t = A v, y\ Jh =y, t/(x, o) = u 0 (x), 

and y is a solution'to the nonhomogeneous equation 

y t = Ay + F, y\ Jk =0, 2 /(x, 0) = 0 . 

As a matter of fact, we obtain for y equation (6) with F = 0. On the 
strength of the maximum principle (see corollaries to Theorem 2, Chapter 
4, Section 2.3) we have 

II j/(x, tA |L < max ( max max | T/) |, [[ u 0 (x) |L ) , 
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provided condition (7) holds. With this relation in view, we derive the 
inequality 


(8) II V 3 ll c < Q max. || y? || Ct + K ll c ’ 

where ||/i|| c := max x g 7ft |/i(x,t)|, which expresses the stability of the 

explicit scheme (3) with respect to boundary conditions and initial data for 

0 ) r<r 0 , ■ 

v a = l « 7 

By analogy with the one-dimensional case in the estimation of y (see Section 
1.7), let us recast the difference equation as y 3+1 = F 3 , where 


F J 


v 

y — 

h i 


a — 1 


P 




+ Tip 


O'— I 


and || Fi || c < [| y || c , + r || p> || c for r < r 0 , thereby justifying that 

II / +1 lie = II FJ He ^ II y j ' He + r II y He 

for the same values of r < r 0 . Summation over j' = 0,1,... ,j yields the 
inequality 


(io) II y 3+1 He < E t lM‘ ll c > t < t 0 , 

i '=o 

characterizing the stability of the explicit scheme with respect to the right- 
hand side. For r < r 0 relations (8) and (10) together imply the estimate 


(ii) \\v 3 + 1 \\c< IK lie- 

With the notation h = min h a! 


max II up |L + Y' r || ||„ . 

o<7'<i+i 1 ,eo C 

the stability condition (9) takes the form 


r < 


y 

2 P ’ 


thus demonstrating that the admissible step r of the explicit scheme de¬ 
creases with increasing the dimension p. 
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2. The explicit three-layer scheme. We now turn to the simplest explicit 
three-layer scheme known as the Richardson scheme and being an analog 
of scheme (59) from Section 1: 


( 12 ) 


y 3+1 - y 3 1 

2 r 


A y 3 + <p 3 . 


However, it is absolutely unstable. Substitution of the half-sum 

\ ( y !~ 1 + y! +1 ) = \ (2 //“ 1 -2 yf + vl +1 ) + y- = f t 2 y - 3 t + y 3 

for y- , where 


y 


3+1 -2 y 3 + y 3 ~ 


Vit 

I ~ 

into the right-hand side yields the p-dimensional analog of the Du-Fort- 
Frankel scheme. The forthcoming substitution 


A y : - Y 


y 


3 (x( +I “)) + y 3 (x^ 1 “- ) ) 


h 2 


- 2 Y y 

otzz 1 01 


leads to an alternative form of writing 


Ai,=r! £ ^ 

a= I « 


which will be involved further in the explicit scheme 


(13) 


r 2 A 

y° + ~y~ y-u = A y + v > 


where 


p 

* = 'E 

a=I 



In the case of a cube grid with h 1 = h 2 = • 
designing one more scheme instead of (13): 


h p = h one succeeds in 


(13') y° + Vit = A y + p 

and in establishing as its immediate implication the useful formula, for de¬ 
termining y = y 3+1 : 


(I+ 27 ) £ = (1-2 7) y + 47 y + 2t Ay + 2t p , 
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where y = j/ 7 , y = j/ 7 “ 1 , 7 = pr//i 2 and A = Aph~ 2 Also, we point out 
here without proving that scheme (13) is stable for any r and h. This fact 
follows from the general stability theory developed in Chapter 6 . Also, this 
scheme generates conditional approximation, since its residual behaves for 
t = 0(h 2 ) like 

ip = Au + p - uo - -p- u ft = 0(h 2 ) 
if we accept <p = / and h 1 = h 2 = • • • = h = h. 

3. Schemes with weights. When discretizing equation (2) in t, the scheme 
with weights arises naturally in one or another form: 

-- t V = A ( (ry j+1 + (1 - a)y j ) + <Pj , 

or 

Vt = A {<ry + (1 - <r)y) + (p , x £ uj h , t = jr> 0, 

(14) 

y\ lh ~ - t/( x . 0) = « 0 ( x )> x ^/,' 

In preparation for this, we agree to consider <p = / = /(x,t- + 1 y 2 ). As 
before, we suppose once again that G is a parallelepiped and A is specified 
by formula (4). We investigate the order of approximation by appeal to the 
expression 

/ 1 \ u + u f 1 \ 

au + (1 - a)u = — - 1 " \ a ~ 2 ) TU t 

for ait + (1 — a) u and, after this, touch upon the residual 

ip = A (a it + (1 — a) it)+ <p — u t 



= L u + (a - ^ t L u + f - ii. + (p - f) + 0( \ h \ 2 + T 2 ) 

= (a - i ^ r L u + 0( \ h | 2 + r 2 ) , 

where L u — A u, u = u(x ) ^- +1 y 2 ) ) p = f and it = du/dt. It is therefore 
concluded that 

ro(N 2 + r 2 ) if ^ = 1 , 

I 0 ( | h | 2 + r) if a ± \ . 
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The maximum principle can be applied to any such scheme with 
weights under the constraint r < r 0 , where 

v ' v a=L a 7 

by means of which it is not hard to show that for a = 1 there is no limitation 
on r. Because of this, a priori estimate (11) for the problem solution is 
certainly true. Indeed, it is possible to reduce (14) to (6), by means of 
which 


A(P) = 1 + 2 a > °" > °> 

a=I « 

S(P, Q)-a E- , (1 - o-) ^2 , 1 ~ 2 (1 - a) . 

a a a —i a 

The restriction r < r 0 follows from the initial assumption concerning the 
nonnegativity of the coefficients B(P, Q). It is clear that D(P) = 0. 

Instead of (14) it is reasonable to deal with the scheme with different 
weights cr a related to the directions x a : 


Vt= E A a (<T a y + {\-<r a )y) 

a— 1 


for which 


T < T o > 



-l 


4. The scheme with increased accuracy. For the stationary problem 


Au=-/(x), u| r = ^(x), 

in a parallelepiped the scheme of accuracy 0( | h | 4 ) has been constructed 
in Chapter 4. In the two-dimensional case p = 2 this scheme reduces to 


A ' y = 


where 


A' y = Ai y + A 2 y + 


K . 

— Ai 


/z 2 /z 2 

A 2 1/, <P = f + ^A 1 f+^A 2 f. 


12 
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We are going to show that the scheme 


h 2 + hi 


( 15 ) Vt = Aa ( a c,y+ C 1 - a a)y) + 1 19 2 Ai A 2 y + <p, 


yL = y , 


12 

t/(x, 0) = u 0 (x) , 


with the ingredients 


(16) 


1 h 2 

= - — —— , a = 1, 2 . 

" 2 12r 

/i 2 h 2 

¥>=/ + 12 Al 12 A2/ ”’ f = f j+U2 > 


provides an approximation of 0(| h | 4 + r 2 ) in light of the representation of 
the residual 


i> = ( A « ~y~ + (~ \) r A « u t) + ~ ' i2 2 AiAo - u + ( l~ u t ■ 


This can be done by inserting the well-established expansions 


u + u 


= u + 0{t 2 ) , 


i t = u + 0(t 2 ) , 


h 2 , 

A„ u = L a u + L- a u , 


A a u t — La A + 0( T” + /t" ) , 


L 2 a u — L a u — L\ L^u — L a f , a = 1, 2 . 


The outcome of this is 




1 L 


h 2 

_a 

12 


<7 " _ 2 T 


L a u + 0(| h | 4 + r 2 ) = 0(| h | 4 + r 2 ) 


with still subject to the first condition (16). In order to prove the 
convergence of this scheme with the rate 0{\h | 4 + r 2 ), it is necessary to 
obtain an a priori estimate for a solution of the problem with zero initial 
and boundary conditions. Having no opportunity to touch upon this topic 
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we address the readers to Chapter 6 and Concluding remarks therein. We 
note in concluding that scheme (15) is stable for any r and h a and do not 
pursue here analysis of this: the ideas needed to do so have been covered. 

The second, no less importance, question is: how to solve the system 
of difference equations 


2 


E 


t C A„ y - y = -F . 


At first glance, the matrix elimination method suits us perfectly. But 
0(N 2 ) operations are required in its application, where N is the total 
number of the nodes of the grid uj h . Just for this reason scheme (15) is 
unacceptable in practical implementations. We will show later that it may 
be replaced by some schemes of the same order 0{\ h | 4 + r 2 ) and 0(N) 
arithmetic operations are required in this connection for determination of y 
by applying successively the scalar elimination for a three-point equation. 
The resulting schemes are said to be economical, so there is some reason 
to be concerned about this. One needs to exercise good judgment in de¬ 
ciding which to consider. The scheme we have constructed above is aimed 
at designing other schemes with the indicated property. Here we will not 
elaborate on these matters. If you wish to explore this more deeply, you 
might find it helpful to refer to Concluding Remarks at the very end of the 
present chapter and references therein. 


5.4 SCHRODINGER TIME-DEPENDENT EQUATION 

1. Two-layer scheme with weights. We are now interested in various dif¬ 
ference schemes for the Schrodinger equation 

0 < x < 1 , t > 0 , 
u(0, t) = u(l, t) = 0 , i = y/—l. 


(1) 


. du 
1 dt = 

u(x , 0 ) 


d 2 u 
dx 2 




By analogy with the heat conduction equation we employ the method of 
separation of variables, in the framework of which a solution of this problem 
is sought as the series 



350 


Difference Schemes with Constant Coefficients 


where 


i 

c k = ( u o. X k) = / u 0 {x) X k {x) dx , 

0 

\ k = k 2 7r 2 , AT(;e) = "v/2 sin 7T&2!. 

Granted the grid w Ar = w 7l x ui r with ui h = {x s = sh, s = 0,1,.. . , TV, 
/iTV = 1} and di r = {£• = j r, j = 0,1,...}, the difference scheme with 
weights 

(2) «t/ t = A (ay + (l - a)y) , y(x, 0) = u 0 (x) , t/ 0 = t/yy = 0 , 

where A y = and <7 = <7 0 + i a 1 is a complex number, comes first. 

Of our initial concern is the residual 


ip = A ( a u + (1 — <t) u ) — iu t 

. U + u j 1 \ . 

= A —— ~jKu t -u t 

= A U + ^ <7 — - ^ tAu-!|1+ 0(t 2 ) 

h 2 

= (A u — i u) + — A 2 u + (<7 — ■}) r A u + 0( h 4 + r 2 ) 

= ( 12 * + ( ~ ^ ) T ) L “ + hA + > 

where u = u(x,tj + ^r), u = du/dt and Lit = d 2 ujdx 2 . It follows from 
the foregoing that 



' 0(h 2 + r 2 ) 

if 

1 

a ~ 2 ’ 


Ip — < 

0(/r 4 + r 2 ) 

if 

1 

(7 = - 

2 

i h 2 

- = (7, 

12 r 


. 0(/i 2 + r) 

if 

<7^ - , 
r 2 ’ 

c yf <7* . 


The scheme so constructed is of increased accuracy for the parameters 

1 ih 2 1 

2 ~ 177 ’ a ° ~ 2 


(7 = 


/l 2 

127 ' 
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The metodology of the method of separation of variables guides the 
choice of y(x, t): 

EEh) = E 4 X k( x s)> 

k = i 

where Xk{x s ) refer to the eigenfunctions of the operator A, meaning, by 
definition, 


AX k + \ k X k = 0, k = 1, 2, ... , TV - 1, ATjfe(O) = AT*(1) = 0 , 
X k (x) = a/ 2 sin 7 rkx , 


4 . , irkh 

A,. = — sm" - 


h 2 

On the strength of the preceding decomposition we establish the recurrence 
relation for the coefficients 


J+i 


9k c k 


k= 1,2,... ,7V- 1, 


where 


9k 


7-(l-o-)rA ft -(1 - <r 0 ) t \ k +*(1 + o-i r A*) 


i + crrA k a 0 T\ k + i(l + a l TX k ) 

and the useful relations for y }+1 : 


y 3+1 = E 1 9k4x k! 

1 = 1 




Af-1 

£ 

1 = 1 


9k 


< max 
k 


9k 


Simple algebra gives 

I 12 (! + °d TX k? + (! - °~o ) 2 t2 K ^ 1 ( 2o ~o - !) EA 2 

Qk (l+o-i rX k ) 2 + a^T 2 X 2 k (l+o-i r Aj .) 2 + o- 0 2 r 2 A| 

implying that | q k \ < 1 and thereby justifying that this scheme is stable: 

II y 1+1 II < HE II < • < IIs/° II f° r a o > 4 


If <7 0 < A, then | q k | > 1 and the scheme becomes unstable, thus 
causing some difficulties. In particular, the explicit scheme with a = 0 is 
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unstable for any r /h 2 = const. In contrast to the approved schemes for the 
heat conduction equation, there are no conditionally stable schemes among 
ones with r/h 2 = const : all the schemes with <j 0 > ^ are stable, while 
others turn out to be unstable. 

We have found earlier for the scheme of accuracy 0{h 4 + r 2 ) that 

1 ih 2 
a ~ 2 127 ' 

The same is still valid for the scheme at hand. From what has been said 
above it is clear that for a 0 = ^ this scheme is unconditionally stable. 

The meaning of stability || y 3 || < M\\y° || with constant M > 1 is 
that we should have 


max | q k | < 1 + c 0 r < e c ° r , c 0 > 0 . 

A similar estimate for | q k | can be derived also for cr 0 < f by merely setting 
t — 0(h 4 ) or 


<T n 


0 


1 

'° “ 2 ~ Va 

Indeed, in the case of interest 


A = 


4 

h 2 ' 


(1 ~ 2(J 0 ) r 2 \ 2 k 
(1 + o-i T\ k ) 2 + a 0 - t 2 A 2 

(1 ~ 2(J 0 ) t 2 A 2 

(1 + o-j r\ k ) 2 + a 2 T 2 \ 2 


< (1 - 2<t 0 ) (rA 2 ) t < c 0 t 


if 


r < 


c 0 /l 4 


(1 — 2<7 0 ) A 2 (1 — 2(7 0 ) 16 
or, what amounts to the same, 


I< < 


(1 + o-j r A) 2 + a 2 t 2 A 2 


for 


1 _ c 0 

2 r A 2 ' 


This provides support for the view that the explicit scheme with a = 0 is 
stable: 

117 II < ||i/° || 

if r < c 0 A -2 = jg c 0 h 4 1 where c 0 > 0 is an arbitrary number. The 
condition r < c 0 /j. 4 is very tough and unnatural. Here r/h 2 (but not 
r/h 4 ) is a dimensionless quantity. Because of this, the explicit scheme is 
unacceptable for the Schrodinger equation. 
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2. Three-layer schemes. Of special interest is the three-layer scheme with 
weights 


i V° = A (a y + (1 - 2 a) y + a y) , 

(3) 

y 0 = yN = G , y°(x) = u 0 (x), y 1 (x) = u 0 (x) ! 

where y = y 3+1 , y = y 3 ~ 1 ) y = y 3 and a = a 0 is a real number. For any 
a the scheme is of second-approximation order with i/> = 0(h 2 + r 2 ). For 
later use, we seek a particular solution in the form yl(x s ) = c k q[ X k (x s ), 
Substituting this expression into equation (3), recalling the definition of 
eigenfunctions AX k = — \ k X k and omitting the subscript k of q k and \ k , 
we eventually get the quadratic equation for q: 

(i +2 ya) q 2 — 2 y(2(r — 1) q + 2 yq — i = 0 , y = r A , 


with discriminant 


— = y 2 (2 a — l) 2 — 1 — Ay 2 a 2 = (1 — 4it) ^ 2 — 1 


Plain calculations show that 

D < 0 for 


1 

a > - — 


1 


4 4 r 2 A 2 

and give the roots of the quadratic equation 

^ 12 ) (2 a — 1) y ± i -J\ + 4 y 2 a 2 — (2 <r — l) 2 y 2 


Under the constraint 


(7 > 


1 


i + 2 y a 


1 


7 (ll2) l = l. 


/U’ 


4 4 r 2 A 2 ’ 

the particular solutions y k do not increase with increasing j: 

\\yl +1 II < Ill'll- 

Being concerned with q^ k ' 2 ^ = } we look for the general solution of the 

problem in view as a sum 

N -1 

y J = E ( a k cos jtp k + !3 k sin jtp k ) X k (x) 

k = 1 
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with a k and f3 k arising from the initial conditions 

V° = «o , y 1 = «o 


or 


y - y 



II 

J 

\r~ 

i 

II 

3 t- 

- ("Uq J Xk ) , 

Pk — ( ( U 1 i Xk) + : 


2a k sin- (ip k /2 ) 


sm (fi k 


No wishing to load the book down with more a detailed derivation of pos¬ 
sible estimates we quote here only the final result 

l|j/ J ||<M(||r/ 0 || + ||r/ t °||) for \ ^ . 

Careful explorations of this sort will appear in Section 6 in trying to estab¬ 
lish stability of schemes for the equation of vibrations of a string. 


5.5 THE TRANSFER EQUATION 


1. Explicit schemes for the Cauchy problem. The first-order equation 


du 

9t 



= 0, 


known as the transfer equation, describes, for instance, the behavior of 


the density p = p(x,t) of incompressible liquid moving along the Ox-axis 


with velocity v: 


dp_ 

dt 



= 0. 


Here we treat it as a model one. However, the arguments about this mat¬ 
ter can result in the design of interesting experiments, whose aims and 
scope are to test and improve admisssible schemes for rather complicated 
equations of acoustics, kinematic integrodifferential equations of neutron 
transfer, nonlinear equations of gas dynamics, etc. Because of the enor¬ 
mous range and variety of problems dealt with by mathematical physics, 
the contents of this section would be of the methodological merit. 
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The problem we must solve is the Cauchy problem 
du 


, ys l *. dll 

(1) m +a ^ =0 ’ 


— co < x < co , t > 0 , u{x, 0) = u 0 (x) 


under the natural premise a = const yl 0. The solution of problem (1) is a 
“travelling wave”: 

u(x, t) = u 0 (x — ai ) , 

where a is the wave velocity and tt 0 (£) is a differentiable function. 

For the purposes of the present section we introduce in the plane (x,t) 
the grid 


X > 

= { x i = ih > * = 0, ±1, ±2, ...} , 

= { tj = i r . i = o, 1, 2, ...} 

with steps h and r in x and t, respectively, and begin by constructing one 
of the well-known explicit schemes for the Cauchy problem 


( 2 ) 


j +1 j 

Vi ~Vi 



Vi = “o ( x i) . 


or y t + a y c: = 0. The pattern of this scheme consists of the three nodes 
(x. t , tj), {x i+1 , tj) and (x it t j+1 ) (see Fig. 17a). 

Obviously, scheme (2) is of first-approximation order with respect to 
r and h, since its residual behaves as follows: 


4> = u t + a u x . = (u + a u') + ~t il + \ah u" + 0{h 2 + r 2 ) = 0(r + h) . 


For a > 0 the scheme at hand turns out to be absolutely unstable. Now 
what we must do is to discover that some particular solution becomes un¬ 
stable albeit with obvious modifications of equation (2): 

(3) ^ +1 =-7^ +1 +(l + 7)^', 

With this aim, we seek a particular solution to this equation in harmonic 
form. This amounts to 


yl = 


e %kip 


(4) 


i = y/=1 


f 0 • 
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7 (*<>*,+ 1 ) • (xi,t j+1 ) 


—• •-•-• 

( x iitj) ( x i-l>tj) ( x i +1 

C 

{ x i >tj+l) 

• - • 

i -1 > ^j + l 


( x i-l>tj) ( x iitj) 

e 

Figure 17. 

Having substituted (4) into (3), we obtain 

q — — J e llp + 7 + l = l + (l — cos p)y — iy sin p 
and find, by simple algebra, that 

| q | 2 = (1 + (1 - cos ip) 7 )" + y 2 sin 2 p = 1 + 47 (7 + 1 ) sin 2 (p/2) . 

Hence, | q | > 1 for any fixed 7 , bounded from below as r — ► 00 , if sin p/2 yf 
0. It is worth noting here that the case where sin<^/2 =; 0 corresponds to 
the values y° k = 1 = const . Then 

| y/ | = | q | —»■ 00 as j —> 00 . 
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Remark Keeping 7 = arfh = 0(h), that is, r = 0(h 2 ), we might have 
| q | < 1 +c 0 r, where c 0 > 0 does not depend on r and h, and the harmonic 
in question remains bounded: 

\yH< e c ° = e c ° < e c ° T = M for 0 <t j <T. 

This means that 

I vl | < M | y° k | 

with the constraint ar/h 2 < <7 (in our example | y° k | = 1 ), where c x = 
const > 0 does not depend on h and r. 

We may recommend one more explicit scheme on the pattern consist¬ 
ing of the three nodes ( 27 ,^), ( 27 , tj +1 ) and (x i _ 1 ,tj) (see Fig, 17b): 


(5) 


? —|— 1 j 

Vi -Vi 


7 7 

Vi ~ vLi 


a > 0 , 


or y t + ay s = 0. This scheme also generates an approximation of order 1, 
since i/ 1 = u t + a u s = 0(h + r). After scrutinising the available information 
on the difference equation 


d 7 " 

y/ +1 = (1 - 7 ) Vi + 7 y/_! > 7 = > 0 > 

we deduce for 7 < 1 that 

II y j+1 He <(1- 7) II 2/ J 'll c + 7ll!/ J 'll c = lll/ J 'llc. 


meaning the stability of the scheme in the space C: 


( 6 ) \\y J+1 \\ c < \\y°\\ c fo1 ' 0< 7 <1. 

By analogy with scheme (2) for a > 0, it is straightforward to verify that 
scheme (5) is unstable for a < 0, while scheme (2) is stable under the 
constraint | 7 | = \a\rh~ 1 < 1, so that the inequality 


\y 1+1 \\c < 


\y J \\ c 


holds true for all 7 = 0 , 1 , 2 ,.... 
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2. Explicit schemes of a higher-order approximation. Of major importance 
is the explicit scheme of accuracy 0(h 2 + r) having the form 

7 , f _ 7 . 3 y 7 — y 7 

%-ft. + a = Q 

r 2 h 

or y t + at/o = 0, where y° . = (j/ i+1 — y i _ 1 )/{2h). This scheme is con¬ 
structed on the four-point pattern (Fig. 17c) consisting of the four nodes 
(x it tj + 1 ), (x it tj), (x i _ 1 , tj) and (x i+1 , tj). Obviously, scheme (7) is un¬ 
stable for every fixed 7 =; ar/i' 1 and arbitrary sign of the coefficient a. 
Indeed, upon substituting harmonic (4) into equation (7) we get the equa¬ 
tion for q: 


q-i+j- 


P np _ p-w 




a t 
h 


q = 1 — i 7 sin tp , 


Whence it follows that | q | 2 = 1 + j 2 sin 2 tp > 1 , so that | y 3 k | = |?| J —► 00 
as j —> 00 . Adopting the arguments similar to those used for the scheme of 
Section 1.10 and replacing y[ by the half-sum \{y k+1 +y k _ 1 ), we obtain 
the stable scheme on the same pattern: 


( 8 ) 

for which 


Vk 


3 +1 


\{vl+ 1 + vi-i) 


Vl+i 


y k ~ 


2 h 


vl +l = i (! + 7) Vk-1 + 5 (! - 7) Vk +1 . 

\\y J+1 \\ c <\\y 3 \\c<---<\\y°\\c 

for any | 7 | < 1 and arbitrary sign of the coefficient a. More specifically, 
for a < 0 we thus have 1+7 = 1 — I 7 I >0 and 1 — 7 = 1 + | 7 | > 0, 

In the estimation of the residual for scheme ( 8 ) it is possible to rewrite 

it as 

0.5 h 2 

y t - y Sx + a y° = 0 

r x 

in light of the trivial relations 

\ {y k +i + y k -i) = 2 (y k +i + y k -i ~ 2 y k ) + y k = y k + \ h~ y SXtk . 



The transfer equation 


359 


The residual on a solution u(x,t) is 

. 0.5 h 2 1 1 h 2 „ , ,, 

V = u t + a u.-— u Sx ~~tu-~—-u +0(h- + T-). 

With the members recovered from the equation il = a 2 u", the preceding 
becomes 


9 

a t 
2 


hpp 

2 r 


u" + 0(/r 2 + r 2 ) , 


which provides support for the view that scheme ( 8 ) generates a conditional 
approximation, because it approximates the equation only if h 2 /r —► 0 as 
/i —^ 0 and r —► 0. In my view, two important things are that for r = 0(h) 
we might achieve i /> = 0 (r + h ) and the second order of approximation 
■tp — 0(h 2 ) is attained for r = h/\a\. 

To make our exposition more complete, we involve the four-point sche¬ 
me of second-order accuracy 


(9) 


yt + a v° - \ Ta 2 y xx = o 


on the same pattern as was done for scheme (7) (see Fig. 17c). Plain 
calculations of the residual with u + au 1 = 0 and u = —ail' — a 2 u" 
incorporated give 


ip = u t + a Uo 


1 2 
2 Ta 


u 




0(i 


au 1 + 0(h 2 ) — ~a 2 Tu" 


+ 0(h 2 + r) 


= (it + a u') + ~t (ii — a 2 u") + 0(h 2 + r 2 ) = 0(h 2 + r 2 ) , 
so that -ip = 0(h 2 + t 2 ). 

Let us investigate the stability of scheme (9) by the spectral method 
having represented it beforehand in the form 

y 3 k +1 = (i-t 2 )% j + ^t(t - + ^ 7(7 + • 

Via transform yl = e lkv we derive the useful expression for q: 

q — 1 — -y 2 (1 — cos ip) — i 7 sin tp , | q | 2 — 1 — q 2 (1 — q 2 ) (1 — cos ip ) 2 , 

by means of which we establish that | 7 | < 1 is a necessary stability condi¬ 
tion, whereas J-y| > 1 is a sufficient unstability condition in the situations 
when |q| is fixed and |q| = const with varying parameters r and h. 
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3. The boundary-value problem. We are interested in learning more about 
the boundary-value problem when the boundary value fj,(t) is specified at 
the point x — 0 and a solution is sought for x > 0 and t > 0; 


du du 

+ a vr- = 0 
(10) ot dx 

u(x, 0) = u 0 (x ), 


t > 0 , 0 < + < oo , a = const > 0 , 

x > 0 , u(0, t) = n(t) , t > 0 , 


under the natural premise tt o (0) = p(0). In the case of the differentiable 
members u 0 (x) and y(t) the function 

f u 0 (x — at) for t<x/a, 
u(x, t) = < 

( fj.(t — x/a) for t > xja , 

is just the solution of the problem under consideration. 

In working on the grid u> h = { x i = ih , * = 0,1,2,...} with spacing h 
and the grid ui T = { tj = jr, j = 0, 1,. .. } with spacing r we construct the 
implicit scheme on the pattern depicted in Fig. 17d in the usual way: 


( 11 ) 


Vk 


j+i 


Vk 


Vk 


i +1 


7 + 1 

Vk-i 


= 0. 


Alternative forms of this scheme 


Vt + a Vi = 0 


and 


7+1 

Vk = 


7 

7+1 


i+i 

Vk-i 


1 

7+1 


vl 


7 = 


>0 , 


are more convenient for later use. With these, the computational procedure 
may be carried out with the starting point k = 1, j = 0. Then 


7+1 


1 

7 + 1 


Vi 


7 

7+1 


MO 


i 

7 + 1 


, 0 (x'j) . 


With knowledge of we are able to calculate the remaining values yj up 
to some j = j . After that, we will find for 0 < j < j 0 , etc. by setting 
k = 2. 

We now deal with the family of schemes on the four-point pattern (see 
Fig. 17e) 


Vt + a Vs + (1 “ +» Vs = 0 . x £ , t £ iu T , 

y(x, 0) = u 0 (x) , y(0,t j ) = 0 } 


( 12 ) 


a = 1 . 
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Observe that scheme (11) belongs to this family, corresponds to the case 
<7=1 and has the residual ip = u t + au s + (i — a) u s . By inserting here 
the asymptotic expansions 

u t = u + 0 (t 2 ) , u s = u' — | hu" + 0(h 2 ) , 

v = v + ^ t v + 0(t 2 ) , v = v — | r v + 0(r 2 ) , 

where v = dL , and v = u=, we arrive at 

ip = | r (2 cr — 1) t/ 7 — h u" + 0(h 2 + r 2 ) 

= |(2o-r + /i — r)w / + 0(/i 2 + r 2 ), 

which serves to motivate that the scheme with weights is of order 2: ip = 
0{h 2 + r 2 ) if cr = | h t~ 1 = <7 0 . In all other cases (cr yf <7 0 ) it is of order 
1 , since ip = 0(r + /i). 

In order to demonstrate that scheme (12) is stable with respect to 
initial data for 


we proceed as usual. This amounts to forming the grid ui h = [x { — ih, 
i = 0, 1, .. . ,7V, hN = / } on the segment 0 < x < l and introducing the 
inner product and associated norm by 

N 

(y> y ] ■= E ViVi h , II2/II — y~\- 

2 — 1 

Other ideas are connected with the well-established expressions 
v=^(v + v)+^(v-v) 

and 

l,. , 1 ,. , 

and forthcoming substitution v = y s . Upon receipt of the available infor¬ 
mation we reduce the scheme concerned to 


Vt + (c - \) T Vst + 5 (Vs + Vs) = 0 . 


2/(0, t) = 0 . 
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The next step is to multiply the resulting equation by 2 t y st = 2 (y s — y s ) 
and take into account that 

2 VtVxt = ‘2vv s = (v 2 ) g + h(v s ) 2 = ( y 2 ) s +h(ij st ) 2 

with v = y t . The outcome of this is 

T (vt)x + 2 ((< 7 - h) T + k h ) (y*t ) 2 + fe ) 2 - (y s ) 2 = o. 

With the aid of the relations 

£(!/;%,< A = E livt ) 2 - {yt)U\ =(y t ) 2 N -(yt)l 

i~ 1 i =1 

and y t 0 — y t (0,t) = 0, since y(0,t) = 0, we get 

(!3) T (y t ) 2 N + 2 ((o-- \)t + \h) || y st || 2 + \\y s || 2 = \\y s || 2 

as a final result of multiplying once again by h and summing over all grid 
nodes x = ih, i = 1,2,... , TV. It follows from the foregoing that 

||2/j +1 ||<ll2/jll< ■■■ <11^11 

if (<r — ~) r + i h > 0, giving a > a 0 . This scheme is stable in the energy 
norm ||t/|| (1) = ||t/ £ ||. 

In Chapter 6 we will deal with the two-layer scheme of general form 

(14) By t + Ay = 0, 

where both operators A and B really act in a prescribed Euclidean space 
H, A = A* > 0 and B > 0. A necessary and sufficient stability condition 
will be established in the form 

(15) B > \tA. 

Moreover, || y 3+1 \\ A < || y° \\ A in the norm || y || A = ^/(Ay, y). 

In studying problem (12) we refer to the space H of all grid functions 
defined on the grid ui h and vanishing for i = 0 and the operator Ay = y s , 
for which the estimate 
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holds true due to the relation yy Sx = ^(y 2 ) x + ~h(y x ) 2 , An alternative 
form of scheme (12) may be useful in the further development: 

(16) (E + err A) y t + Ay =■ 0. 

Since A > 0, there always exists the inverse A~~ 1 > 0, by means of which 
we recast (16) as 

(17) (A -1 + o-T E) y t + y = 0. 

Comparison of (17) with (14) shows that B = A -1 + err E, A = E and 
condition (15) signifies that 

f (A -1 + cr t E) x, x) — 7 t (x, x) 


= (A 1 x, x) + (a - ^) t (x, x) > 0, 

yielding (Ay, y ) + (<7 — 7) r || A y || 2 > 0 for the substitution A~ 1 x = y and 
providing the relation (Ay, y ) = ^ y^ + ^ h\\ Ay \ \ 2 in the case of interest. 
The stability condition (15) taking now the form 

(i8) \y 2 N + (\h + (a - 7) r) || Ay\\ 2 > 0 

is valid for a > <t 0 . This provides enough reason to conclude that the a 
priori estimate \\y 3 || < ||j/°|| is certainly true. Likewise, a scheme with 
weights may be designed for the system 

du dv dv du 

dt dx ’ dt dx ’ 

which is equivalent to the equation of vibrations of a string 

3 2 u _ d 2 u 
~dE ~ dx 2 

and the stability conditions for such a scheme may be established in a 
similar way as we did before. 
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5.6 DIFFERENCE SCHEMES FOR THE EQUATION 
OF VIBRATIONS OF A STRING 

1. The statement of the difference problem and calculations of the approx¬ 
imation error. In this section we study the equation of vibrations of a 
string 

d 2 u 9 d 2 u . 

~dt 2 = a ~ ~d^~ + /(*! . )» 0 < > 0. 

In this view, it seems reasonable to pass to the dimensionless variables 
x = x 1 /l and t = at 1 /l, due to which the initial equation is representable 

by 

d 2 u d 2 u 

(1) = ^ + /0M)> 0 < x - < 1 , o <t<T. 

At the initial moment the supplementary conditions are specified by 

, . , . du(x, 0) . . 

(2) u(x, 0) - u 0 (x) , - — - =u 0 (x), 

where u 0 (x) is the initial deviation and u 0 (x) is the initial velocity. The 
string’s ends move in accordance with the known laws 

(3) «(0, t) = fi^t) , u(l, t) = n 2 (t) . 

By analogy with Section 1.2 we introduce in the domain D = { 0 < x < 
1) 0 < t < T} the rectangular grid H> hr . As equation (1) contains the 
second derivative in t, the number of layers cannot be any smaller than 3. 
Retaining the preceding notations, we have 


,■ - ,•+1 ,--i y-y y-y 

y = y\ y = y- , y-y J , y t = -. y% = -> 

r r 

^ y y&x! 

y t -yi_y- 2 y + y _ vt + vr _ y-y 

m ~ T ~ r 2 ’ y t - 2 " 2 r ' 

As before, we replace the derivatives built into equation (1) by the formulae 


~ u 


tt > 


A u = u s 


8 2 u 

dt 2 


d 2 u 

W 2 


f ~ <p- 
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A key role in subsequent discussions is played by a family of schemes with 
weights 

yu = A ( a y + i 1 - 2a )y + a y) + , ( p = /(*> C). 

( 4 ) 

y 0 =^(t), Vn = y 2 ( 0 . y(x,0) = u 0 (x), y t (x,0) = u 0 (x) , 

where u 0 (x) will be specified below. 

The boundary conditions and the first initial condition u(x, 0) = u 0 (x) 
on the grid u> hr are satisfied exactly. A choice of u 0 (x ) is stipulated by the 
wishes that the approximation error u(x) — du(x,0)/dt = u{x) — u 0 {x) 
would be a quantity of order 0(r 2 ). From the chain of the relations 

u t (x, 0) = u(x, 0) + i Til(x, 0) + 0(r 2 ) 

= u 0 ( x ) +\ T ( u "( x > °) + f( x > °)) + °( t2 ) 

= <i x )+ \ T ( u o( x ) + f( x , 0)) +0(t 2 ) 

it is readily seen that u{x) — u t (x, 0) = 0(t 2 ) if we accept 

(5) u 0 (x) = u 0 (x) + \ t («"(*) + f(x, 0)) . 

Thus, the difference problem (4)-(5) is completely posed. With regard to 
y — y 3+1 we set up on the basis of (4) the boundary-value problem 

a 7 2 ( Vi+i + ) ~ (! + 2 a- q 2 ) y 3+1 = -F { , 0 < i < N , 

T 

Vo - Pi - Vn = P 2 > 7 = X 1 

Fi ~ (2 y 3 - y 3 ~ l ) + r 2 (1 - 2 a) A y J + a t 2 Ay 3-1 + r 2 cp , 

which can be solved by the right elimination method, stable for any <7 > 0 
(see Chapter 1, Section 2.6). 

The next step is to calculate the approximation error of (4) in the case 
(p = f(x,tj) by investigating the difference between a solution y of problem 
(4)-(5) and a solution u = u(x,t) of problem (l)-(3). Substituting y — z + u 
into (4) yields 

z tt = A ( <jz + (1 — 2 < 7 ) z + crz ) + 1 / 1 , 


(6) 


z 0 = z N = 0 , 


z(x, 0 ) = 0 , 


z t ( x , 0 ) = v{i :) , 
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where ip = A(<7U + (1 — 2 a) u + a u ) + tp — u^ t is the approximation 
error of scheme (4) on the solution u = u(x,t ) and v — u 0 (x) — u t (x , 0) 
is the approximation error for the second initial condition y t = u 0 (x). In 
accordance with what has been said above, v = 0(r 2 ). The well-established 
expressions and it = u — t u t allow us to deduce that 

<7 it + (1 — 2 a) u + cr it =■ u + cr r 2 Uf t , 


implying that 

ip = A u + cr r 2 A Uf t + tp — 

(7) — L u + a t ' 2 L ii + f — il + 0(h 2 + r 2 ) , 


Moreover, ip = 0(h 2 + r 2 ) for an arbitrary constant a, which does not 
depend on r and h. 

Let a = a — h 2 /(12 r 2 ), where the constant a independent of h and 
r is so chosen as to provide the stability of scheme (4). As can readily be 
observed, it suffices to take a > ^ (1 — £) _1 , since scheme (4) is stable for 
<7 > ^ (1 — £) _i — i 7 -2 , 7 = t/} i, £ > 0. Scheme (4) with the member 

(8) 7> = /+^r 

permits us to make the order of approximation more higher and achieve 
ip = 0(h 4 + r 2 ). 

The boundary conditions of the third kind 


<9u(0, t) 
dx 


= A «(0, t) - y^t) , 


du( 1 , t) 
dx 


- A A 1 , 0 




are approximated by the following difference equations: 


PiVit= A (o-y+(l-2a-)y + a-y) +<p , i = 0, 

P 2 Vit = A+ (A y + (! - 2 <t) y + a- y) + <p + , i = N , 


where 


A y 


Vx ~ Pi V 
h/2 

Aj_ 
h/2 


+ = _ y, +P 2 y 

y h/2 ’ 

^ += ^+ IJ 2 - 


(fi = p 1 p> + 



Difference schemes for the equation of vibrations of a string 


367 


Here the approximation error for the boundary conditions is a quantity 
0(h 2 + r 2 ) if 


= Pi = />2 = 1 > Vi=Lh(t)> 

The forthcoming substitutions 
h°- 

r , a — const , 


p 2 {t) ■ 


12 T 2 


_ 1 , h Pi _ ! , h 

Pi ~ 1 ) P2 ~ 4 + 1 


p = /0M) + i2 r. 

l(t) = Pi(t) + — ^ ^ + ,f'( 0, t) ~ /?! /(0, , 

2 (t) = H 2 (t) + y ( - /' (1, t) - /? 2 /(1, 0 ) 


are best suited for the design of the scheme of accuracy 0{h 4 + r 2 ) approxi¬ 
mating the initial equation at the nodes x = 0 and x = 1 to 0((/i 4 + r 2 )//i) 
and the boundary conditions to 0(h 4 + r 2 ). 

2. Stability analysis. We now investigate the stability of scheme (4) with 
respect to initial data in the case of homogeneous boundary conditions and 
zero right-hand side of the equation. A reasonable statement of the problem 
is 


Vtt = A (<?$ + (1 - 2<r)t/ + ay) = Ai/ a \ 

(4a) 

2 /o=2 //v=°> y( x > 0) = u o( x ) , Vt( x , 0) = u 0 (x) . 


On the same grounds as before, we look for its solution by the method 
of separation of variables, still using the framework of Section 1.4 where 
particular solutions are sought as a product y(x,t) = X(x)T(t) ^ 0. Sub¬ 
stitution of y = X T into equation (4a) gives 


(9) 


M = A = 

X tm 


Putting these together with the boundary conditions y 0 = y N = 0 we set 
up the eigenvalue problem for X(x): 


h 1 


A X + A A = 0 , 


x G 


A(0) = A(1) = 0, X(x)£0, 
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whose solutions are 


\ k = -^ sin 2 , X( k \x) = V2 sin irkx . 

From (9) we get the difference equation of second order for T k (t): 

{T k )- n + X k Ti a) = 0 

or the equation 

(1 + (tt 2 X k )f k - 2 (1 + (a - \)t 2 \ k ) T fc + (1 + 0 -T 2 X k )f h = 0 , 
which can be rewritten as 


(10) T k — 2 (1 — a k ) T k + T k = 0 , 


Otu - 


1 T 2 \ 

2 T A k 

1 + a t 2 X k 


We may attempt a solution of the preceding equation in the form 
T k = T k (tj) = q 3 k . Thus the quadratic equation for q arises from (10): 
q 2 — 2 (1 — a) q + l = 0 (the subscript k is omitted for a while). Careful 
analysis of its roots q t 2 = 1 — a ± \/a 2 — 2 a shows that for 0 < a < 2, 
the values q 1 2 — 1 — a ± i \Ja (2 — a) are complex with | q t 2 | = 1. It is 
sensible to pass to a new variable tp k for which 


cos ip k =1- a k , 


sin Ffc = V a k (2 - a k ) , 


making it possible to get q{ h ^ = e l v k and = e llp k ) due to which the 
general solution to equation (10) is representable by 

T k (tj) = C k (q(»y + D k (qW)’ = A k cos j<p k + B k sin jip k , 

where A k and B k stand for arbitrary constants. 

After that, wejook for a solution of problem (4a) as a sum of particular 
solutions 


( 11 ) 


N -1 


V 3 = E ( A k cos j<p k + B k sin j<p k ) X( k \x) . 
k-1 


Let u ok and u ok be the appropriate coefficients in the relevant expansions 
of u 0 (x) and u 0 (*): 


(12) u 0 (x) = X) u ok X( k \x) , 

k = 1 


3 (x-) = X) «0 k x(k K x )- 

k = 1 
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By relating the initial conditions y° = u 0 and y° = ( y 1 — y°)/r = u 0 (x) 
to hold for sum (11) we establish the relationships for determining the 
coefficients A k and B k : 


At 


l 0k i 


Ai 


cos <p k - 1 


B k = u 


Ok > 


making it possible to find that 


(13) 


A 


k — u ok 


1 - COS (fi h 

Bk = -:- U, 


Ok 


U 0 k 


sin ip k - sin <p k 
Having substituted A k and B k into (11), we are led by minor changes to 


iV-l 


(14) 


r 


V - '' I COS U 2 ) Pk 
2 ^ ( — i.- — u ok 


k = 1 


COS 


t sm ]y k 

sin ip k 


Uok)X^{x). 


After the first stage the estimate of || y 3 || for scheme (4a) will be 
derived for <7 = 0 relating to the scheme 

(15) y it = Ay } y 0 = y N = 0, y(x, 0) = w 0 (ai), y t (x, 0) = u 0 {x). 

In that case 

a k = 5 1-2 h = Ak > cos <p k = 1- y k , sin <p k = ^y k (2 - y k ) . 
When the steps of the grid uj hT are related by 

1 


(16) 


T' 

h 2 ~ 1 + £ 


where £ > 0 is an arbitrary number, we find that 
2 


1 + £ 


(17) Hk < 

yielding 

(18) cos \<f h = 

By virtue of the relations 

sin cp k __ 2 sin \ip k 


k = 1, 2, ... , TV - 1 , 


l-^> 


1 + £ 


cos \ip k > 


2 sin 1 <p k 


1 + £ 
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and 


2 sin \ <p k \/2 (1 - cos tp k ) __ 757^ 


“ \/^k 


the estimate occurs: 

(19) 


sm . 0 £ 

> 1 / A k 


t V " 1 + £ 

Observe that expansion (14) implies that 


\y J \\ < 


N -1 


E 


COs(i - 5)^ 


; COS 2 ‘Pk 


u ok X {k) 


N-L 

E 

1 


r sm jip k _ 


sin ip k 


l 0 k 


Using estimates (18) and (19) behind we finally establish 


II < 


1 + £ 


We note in passing that the expression 


N -1 


y- (n 0 fc ) 

^ A, 


Y '' 1 ( n 0 fc ) 
, ^ Xk 


2 \ 1/2 


2 \ 1/2' 


k -1 


is nothing than one admissible norm on the space H A -1 known as the 
negative norm: 


I «o IIa -1 ( A u g , u g ) 


- 1 -". « 

0 > u o 


where Ay = —Ay = —' n the space of all functions y defined on the 
grid uj h and vanishing at the points x = 0 and x = 1. Indeed, 


N -1 


N- 1 


a-'5 0 = E = E ir x(i) > 


fc = l 


k = 1 


implying that 


jV-1 


(a u 0 ,w 0 ) — 'y ' 


fc = l 


(«ofc) 2 

A 1 . 


Thus, we have proved that under condition (16) scheme (15) admits the 
estimate 
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This estimate remains valid for scheme (4a) under the constraint 


( 21 ) 


(7 > 


1 + £ 
4 


h 2 

4^2 ’ 


where e > 0 is an arbitrary number. To make sure of it, we should replace 
everywhere in the above proof y k by a k = (| r 2 X k ) (1 + a r 2 X k )~ L . 

The superposition principle unveils its potential in investigating the 
stability of scheme (4) with respect to the right-hand side by considering 
the problem 


( 4b ) Vit = A 2/ (<7) + ‘P> 2/o=2/jv = °» y( x ’ 0) = 0 , y t (x, 0) = 0 , 

whose solution is sought as a sum 

(22) y 3 = E tY 3 ’ 3 ', 

i '=0 


where Y 3,3 as a function of j solves for fixed j' the homogeneous equation 

(23) Y { 3 ’ j ' = A(a Y 3+1 - 3 '+(1-2(t)Y 3 - 3 ' +<r Y 3 - 1 ' 1 ' ) t , 0 < f < j , 

supplied by the boundary conditions 

(24) Y 0 j,jl = Y^ ,j ‘ ~ 0 
and the initial conditions 

, , y j'+i.j' - vY,Y y 3 ‘ +1 ’ 3 ' •/ 

(25) Y 3 ' 3 = 0 , Y 3 ' 3 = - = - = , 

r r 

where is so chosen as to satisfy the nonhomogeneous equation (4b). 

A similar problem arises naturally for the function . By the defini¬ 
tion of Y 3,3 , 


, 3 = 
tt 


^Y 3 ^ 3 +Er^ 
T j‘=o 


7-i 

A= <tt AY 3 + 3 ' 3 + t A(Y 3 ' 3 ‘) {a \ 
j'=o 
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Putting these together with (4b) we find that 

(26) y 3+1,3 _ aT ? AY 3+1,3 _ T(p i } 

which allows us to derive the equation for <f> = = Y 3+1,3 t~ 1 : 

(27) <f> - a t 2 A <f> = (p , $ 0 = (Jyy = 0 . 

For the purposes of the present section, let us estimate a solution y 3 of prob¬ 
lem (4b) in terms of the right-hand side (p, provided the stability condition 
(21) holds. Having stipulated this condition, estimate (20) is certainly true 
for a solution of problem (23) and takes for now the form 


Y 3,3 


< 


1 + £ 


yl, 3 


1 / 1 + £ 
T 


Y 3 + 1,3 


A” 1 


By the triangle inequality we deduce from (22) that 

7-1 


y 


3 il < 


1 + £ 


yj'+i.j' 


7'=0 


Equation (27) is needed in obtaining a bound of Y 3 +1,3 , in which 

II \\ 1 

and (p should be expanded in the series with respect to the eigenfunctions 
of the system {X (*)}; 


(28) 


IV-1 

<f> = E ®kX( k \ 

k -1 


N-l 

= E PkXi k \ 

k = L 


Substituting (28) into (27) gives = <p k (1 + crT 2 \ k ) C With these rela¬ 
tions in view, we establish for <7 > 0 


! *HF.= £ ? = £ 


9 

‘Pk 


k = 1 


k = 1 


(1 + a t 2 X k ) 2 \ k 


N -i 9 

< £ v i = \M\Y 


k = l 


meaning 


y7 +i,7 


< r || ip 3 


Thus, if a > 0 and condition (21) is fulfilled, the estimate holds for 
scheme (4b): 

7-1 


\y 


3 II < 


1 + £ 


£ 

7 ' = 0 


r || <p J 
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By exactly the same reasoning as before we deduce for problem (4) with 
zero boundary conditions y 0 = y N = 0 that 


< 


1 + £ 


7-1 

E 

7' = 0 


under condition (21) and the restriction a > 0. Intuition suggests and in 
this case it does not deceive us that for a special choice y 1 = t/(r) the 
stability of scheme (15) under the constraint r < h may be proved in the 
space L 2. 

We learn from Section 5.1 that the difference scheme 

( 29 ) yi< = yL> 3 = 1 . 2 ,, 


k T y°- 

2 


(30) y° = u 0, y° = u 0 

provides an approximation of 0(h 2 + r 2 ) to equation (l)-(2). Other ideas 
are connected with expressions of the solution y 3 in terms of y° 
u 0 . Following established practice, we find that 


u 0 and 


(31) 


r 


N- 1 


k—\ 


l ok cos 3fk 


T U 


Ok 


sm (fi k 


sm 3f k 


x(*). 


where u ok are Fourier coefficients of u 0 (x), the sense of the quantities u ok 
and (p k being reserved. Squaring (31) and applying the estimate 

-,2 


T U 


Ok 


sm <p k 
we obtain 


cos j<p k u ok sin j<p k < t 


u 


Ok 


sin 2 yo k 
N -1 


cos 2 j yo k 


Ok 


sm JVk . 


I y 


7 II 2 


< 


i 2 + £ E 


ok 


III Sm Vk 

To evaluate the lower bound of the expression 

r 2 1 


sin 2( Pk X k (1 - 5 r2 ’ 

we take 7 = r/h < v l. Along these lines, it is evident that 


A* 1 


A t 


> 


4 

• 2 

sin 

irkh 

h 2 

2 

4 

• 2 

irkh 

h 2 

sm 

2 

4 

• 2 

sm 

7T&/l 

P 

2 

4 


irh 

P 

sm' 

~2 


1 - 7 2 sin 2 


irkh 

~Y 


irkh \ 

~Y J 


irkh 


irh sin 2 irh 

T = h 2 
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In Chapter 2 it has been already shown that 4h 1 2 sin 2 (|7r/ij ) > 8 if 
h j < Therefore, keeping h x = 2 h we find that 

sin 2 7r h 4 . 9 7 r/i, „ , 1 

——— - —- sin 2 —h > 8 , h< - . 


Thus, if t < h and h < 1/4 the proper estimate for the solution of problem 
(29)—(30) is 


3. The energy inequality method. An investigation of difference schemes 
for the string vibration equation may be carried out by means of the energy 
inequality method (see Section 1). Here we restrict ourselves to stability 
with respect to the initial data with regard to the problem 


Vit = A ( cry + (1 - 2a) y + ay ) , 

(32) 

%=J//v = 0. y(x, 0) = u 0 (x) , y t (x, 0) = u 0 (x) . 

Bearing in mind that <7 1 ) + (1 — 2 a ) y + o"y = t/ + <7 r 2 and attempting 
equation (32) in the form 

(33) (E - or 2 A) y ft = Ay 

where E is the identity operator, we take the inner product of the resulting 
equation (33) and the quantity yo = ( y t + t/ t -)/2. The outcome of this is 

(34) ((E - aT 2 A)y it , yo) = (Ay, yo) . 

The trivial identities 

(Vtt 2 (II 11 ) t ’ — (^yjt > y °) (Vstt i y g ° ] 2^11 ] I ) ^ 

help rearrange the left-hand side of equality (34) as 

(35) ((E - o-t 2 A)y t - t , yo) - ^ (|| y- t || 2 + a r 2 11 y Ts }\ 2 ) ( . 

Further, we will show that for any function y = y(x, t n ) vanishing at 
the points x — 0 and x = 1 


— (Ay, yo) = - (||y £ + J4.]| 2 ). - ^ 


I Vtx 


(36) 
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Indeed, from the first Green formula (see Chapter 2, Section 3) it follows 
that 

— (Ay, j/o) = { v, vo } 

with v = y s . Having involved in the further development 
V ■ V ° t = h (( V + V) 2 ) t - y ((^) 2 ) t > 


we arrive at identity (36). 

Substituting (35) and (36) into (34) yields the energy identity 

( 37 ) ( II Ut l| 2 + ( a ~ 4 ) T ' 2 II Vis ]| 2 + 4 II Vx + Vx ll 2 )^ = 0 

or £ 7+1 = where 

(38) £i := || yj f + (<r - \) r 2 ||4]| 2 + I || + yf - 1 ]| 2 . 


Let us find the values of a, for which the quantity 8 3 is nonnegative when 
y 3 and y 3_1 are arbitrarily taken, by simple observations (see Chapter 2, 
Section 3) that 



With this in mind, we conclude that the right-hand side of (38) is nonneg¬ 
ative if 


(39) 



1 

4 q 2 


7 = 


r 

h 


Here the expression (S^Y^ = \\yi can be viewed as a norm (or, more 
exactly, as a seminorm), permitting us to write down 


(40) = \\y 3 \\l = \\yt \\ 2 + {v ~ r 2 \\y?-]\ 2 + \\\yl+y? Ml 2 - 

Note that such combined norms depending on values of y on several layers 
are typical for multilayer schemes. This is especially true for three-layer 
schemes. 
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The identity (37) implies the stability with respect to the initial data 
in the norm (40): || yi +1 = || y° 1^ for all y = 0,1,.... 

So, condition (39) is sufficient for the stability of scheme (32) with 
respect to the initial data in the norm (40). In particular, scheme (32) with 
cr = 0 is stable with respect to the initial data under the condition 

(41) t < h . 


Often this stability condition is named the Courant condition because 
it has been proved for the first time by R. Courant, C. Friedrichs and G. 
Levy in 1928. 

For the equation in the dimensional variables 


(42) 


d 2 u _ 2 d 2 u 

5G - “ fk 2 


condition (41) takes the form r < h/a, where a is the sound velocity. 

4. Determination of nonsmooth solutions by the difference method. Nu¬ 
merous problems of mathematical physics describing shock processes in 
gases, liquids and solids lead to the problem of determining nonsmooth 
solutions of second-order hyperbolic equations, the simplest of which is 
equation (42) of vibrations of a string. Since those solutions do not pos¬ 
sess the second-order derivatives involved in the equation, the words “a 
solution satisfies the equation” should be understood in some generalized 
sense. One of the possible definitions of generalized solutions is due to the 
fact that the differential equation follows from an integral conservation law 
if continuous derivatives emerged in equation (42) exist. In this case the 
generalized solution is meant as a. function u(x,t ) having in the domain 
G={0 <a:</, 0 <t<T} the bounded piecewise continuous derivatives 
du/dx , du/dt and satisfying the integral equation 


du , o du , . 

~dt dX + “ dx dt = ° ’ 


where C is an arbitrary closed curve in the domain G. If the first derivatives 
are discontinuous, then for the characteristics x ± at = const the jump 
conditions should be satisfied: 


du 

dt 


= ± a 


du 

dx 


[/] := /(£ + 0) -/(£ - 0) as (_=x±at. 



Difference schemes for the equation of vibrations of a string 


377 


In giving a generalized solution of the problem 
d 2 u , 0 d 2 u 

—— the = cr —— 0, 0 < x < l , t> 0, 

or Ox/ 

du 

u(x, 0) = u 0 (x), 0) = u i ( x ), u(0,t) — 0, u(l,t) = 0, 

we rely on the scheme with weights 

( 44 ) Vit = A(ay + (1 -2a)y + ay) , Ay = a 2 y Sx , 

with the appropriate supplementary conditions. When studying the conver¬ 
gence of the scheme with weights, it is supposed that a solution of problem 
(43) exists and is smooth enough. It is possible under certain conditions 
relating to the smoothness of the initial data. 

Does the same scheme converge if u = u(x, t ) is a generalized solution? 
The grid solution of problem (44) turns out to converge to the generalized 
solution with the rate 0{\/\fh + r). We do not dwell on confirming this 
statement. 

In trying to find a generalized solution of problem (43) one can come 
across oscillations of the grid solution and its derivatives (“ripple”), which 
essentially reduce the accuracy of a scheme. What is more, the lines of 
discontinuity of derivatives spread over several grid intervals, thus causing 
the difficulties in determination of proper discontinuity propagation veloc¬ 
ity. This is the result of introducing the fictitious friction (dissipation) in 
the difference approximation. 

The ripple is stipulated by the fact that difference harmonics reveal 
the dispersion, that is, determination of a harmonic velocity depends on 
its number, whereas for the differential equation all harmonics have the 
same velocity a. In order to improve the quality of a scheme, one needs 
to minimize the dispersion. Among various schemes (44) with weights the 
scheme relating to' 


(7 = < 7 , 


1 ( 1 

12 V 1 ~ 


7 = 


CIT 

h 


has the minimal dispersion and allows us to overcome the obstacles men¬ 
tioned above. It is of order 4, that is, 0(r 4 + h 4 ) on sufficiently smooth 
solutions u = u(x,t). On nonsmooth generalized solutions the approxima¬ 
tion error for scheme (44) with the weight a = u* is as large as for schemes 
with any weight cr ^ <r t . However, due to reduced dispersion the scheme 
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with the weight a = <7* is more precise and reproduces much more better 
the characteristic features of generalized solutions. 

A stability condition established for scheme (44) such as 

1_ 1 _ _ 1 / J_\ 

4 4 y 2 4 V y 2 / 

is certainly true for the scheme with the weight <7 = a * if 7 < 1 or r < h/a, 
that is, under the same condition as for the explicit scheme. In this context, 

Let us stress here, that in an attempt to relax the “ripple” by introduc¬ 
ing the viscosity, the distortion of the solution profile and accuracy losses 
occurred. 


5.7 SELECTED PROBLEMS 

1. For the heat conduction equation the difference scheme is suggested: 


J . = i (J + l . + yi .) * = 1,2,... , 

2 2 a XX t %) ’ 

yi=if N = o, y 0 i" u o(x ' l) ' 


Prove its absolute stability, find the order of approximation and point out 
the method for solving the problem. 

2. Find the order of approximation for the difference scheme 


y° = u o( x i ). 


yj +l ~yj = I (m+i 

2 \ i 


h 2 

vL i ) - 77 : v’t 


i = 1 , 2 ,... ,tv - 1 , 


y 3 n = vl, = 0 


prove its absolute stability and investigate the stability of the elimination 
method being used for determination of 


Vi 


+ 1 


i = 1,2,... , TV - 1 . 
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3 . The statement of the problem is 


du d 2 u 
dt dx 2 


0 < a? < 1 , t > 0 , 


du 

M) = MiW> u(l,t) - n 2 (t) , 
u (x, 0 ) = rt 0 (a;) . 

Construct a perfect difference scheme of accuracy 0( r 2 + h 2 ). 
4. Find stability conditions for the difference scheme 


= ° + (!--) yL. y? +]1 + (1 - m ) y-) 


j = 1,2,... ,7V- 1 

(j ~ (7q + i <J a , 


s£=°> v,° = u o(*,-), 


y = y 0 + * Mi. 


approximating the equation 
. <9u d 2 u 

l m=d^- qu ' 

u ( 0 , t) = u ( 1 , t) = 0 , 


q = const > 0 , 


u (x, 0 ) = u 0 (x). 

5. Determine the exact solutions of the boundary-value problem 


du dit 
dt + dx 

u (x, 0 ) = u 0 (x ), 


0 < x < X 


0 < t < T. 


; ( 0 ) t) - Uj (0 , 


and of the difference scheme approximating this problem: 


Vt,i + y^,i ~ 0 > 

y°i = u o( x i ). 
x i — i h , 


7 = 1,2,..., n = 0, 1,2,... , 

y’o ~ «i(0 . 

t n =nr. 


Proceeding from the explicit representation of solutions, show that if the 
condition j = r/h = const is fulfilled as r -» 0 , ft -» 0 , then convergence 
occurs only for 7 < 1 and the difference problem solution coincides with 
the differential problem solution for 7 = 1 . 
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6 . The problem 


du d 2 u d 2 u 

di = dh 2 + £hf ’ 0<X 1 <1 1, 0 < x 2 < h > 


' ( x j 0) = 0 , 


eG = jo<i 1 <i 1 ,o<i 2 < / 2 }, 


u(x,t) = 0, x £ dG, t> 0, 

is approximated by the explicit difference scheme on the grid 


r = w h x = {t n - nr, t > 0} , 

w h = * 2 ( ^} > x i l) = > x 2 (7 ' ) = i ^2 . 

i = 1,2,... , TVj — 1 , j= 1,2,... ,7V 2 -1, h 1 N l = l t h 2 N 2 = l 2 - 

What maximal step r in time should be taken to provide stability of the 
scheme when /j = 1, l 2 = 10, At, = 10, 7V 2 = 100? 

7. Prove for the problem 


du du 
dt dx ’ 

u (x, 0) = u 0 (x), 
u (0, t) = 0 , 

that the difference scheme 


t > 0, 


t > 0 , 


-oo < x < 0 , 


yi +l -yi vi-id -1 


is absolutely unstable and the scheme 

yj +l - yj = yj+i - yj 

t h 

is stable under the condition r < h . 

8 . Show that for any r and h a pure implicit difference scheme (a forward 
difference scheme) approximating the problem 


du d 2 u 

o<x<i, 

u(x, 0) = u 0 (x ), 
du . , du . 


t > 0 , 


is not asymptotically stable. 
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9. For the three-layer scheme 


y% t 


b y - +1 

■l **a:x 


+ (i- 


2 ) y n 

^ XX 


+ <j 2 y 


n — 1 
a;:c 


a) investigate the approximation error, b) find a stability condition, c) 
impose the initial conditions yP, yP, i = 0, 1, . .. , TV, not changing the order 
of approximation for this proposal. 

10. What differential equation is approximated by the difference equation 


(1 +2 7 )y^ = ( f - 2 7 ) yr 1 + 2 7 (y? +1 + ) 


where 7 = r/h 2 . Find the order of approximation for this. 




Stability Theory of 
Difference Schemes 


In this chapter we study the stability with respect to the initial data and 
the right-hand side of two-layer and three-layer difference schemes that 
are treated as operator-difference schemes with operators in Hilbert space. 
Necessary and sufficient stability conditions are discovered and then the 
corresponding a priori estimates are obtained through such an analysis by 
means of the energy inequality method. A regularization method for the 
further development of various difference schemes of a desired quality (in 
accuracy and economy) in the class of stability schemes is well-established. 
Numerous concrete schemes for equations of parabolic and hyperbolic types 
are available as possible applications, bring out the indisputable merit of 
these methods and unveil their potential. 


6.1 OPERATOR-DIFFERENCE SCHEMES 

1. Introduction. In Section 4 of Chapter 2 the boundary-value problems 
for the differential equations Lu = —/(a;) have been treated as the operator 
equations Au = /, where A is a linear operator in a Banach space B. 

In the study of nonstationary processes described by partial differen¬ 
tial equations of parabolic and hyperbolic types 

du d^u 

-Qj- = Lu + f{x,t) , -Qjj = Lu + f(x,t) , o < t < t : , 
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the variable t (time) plays a key role and, following established practice, 
should be marked out throughout the entire chapter. Here L is a differential 
operator acting on u(x,t ) as a function of a point x = (aq, x 2 , ... , x p ) in 
some p-dimensional domain G. For any fixed t, the function u(x,t ) is an 
element of the Banach space B. Therefore, instead of u(x,t ) we obtain an 
abstract function u(t) of the variable t, 0 < t < t : , with the values in the 
space £>; meaning u(t) £ B for all t £ [0, t 0 }. The operator L acting on 
u(x,t ) as a function of the variable x is replaced by an operator A acting 
in the space B. The operator A generally acts from a space £>i into a 
space £>2 (its domain V(A) C £>i is everywhere dense in £>i, while its range 
H(A) C £> 2 ). In this regard, we take for granted that B\ = £> 2 = B, making 
it possible to set up the abstract Cauchy problem 

du , . 

— + A u = f(t) , 0 < t < t 0 , u(0) = u 0 , 

where u 0 is a given element from the domain V(A). 

The above reasoning is of a heuristic nature and is aimed at carrying 
out some analogy between the methods of the general theory of differential 
equations and those of the theory of difference schemes, the framework and 
methodology of which are outlined in this chapter. 

A Cauchy problem is said to be stable with respect to the initial 
data and right-hand side if 


t 

\\ u (t)\\<M L \\ u 0 \\ + M 2 J ||/(C)|| dt\ 

o 

where M\ = const > 0 and M 2 = const > 0 . 

In conformity with the superposition principle (^4 is a linear operator), 
the stability of the Cauchy problem with respect to the right-hand side 
follows from the uniform stability with respect to the initial data 

II u {t) II £ Mi || u(t') || , t >t' >0 , 

where u(t ) is a solution of the homogeneous equation. 

2. Operator-difference schemes. We now consider a linear system Bh de¬ 
pending on a parameter h as a vector of some normed space equipped with 
the norm \h\. With regard to the linear system Bh, it is reasonable to 
introduce a collection of norms || • || ft , || • ||( ift p || • ||^ 2 , )> • • •, thus causing 

linear normed spaces Bh , B^ , B^\ .... For the sake of simplicity, we 
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involve in further development the norms || ■ [[^ y || ■ • on the 

space Bh, assuming || ■ || ft to be a basic one on Bh- 

At the next stage we introduce on the interval 0 < t < t 0 a r-step grid 
= {tj = jr, j = 0 , 1 ,. .. ,i 0 , t = t 0 /j 0 }, lo t = {t j = jr, 0 < j < j 0 } 

and pass to abstract £>/,-valued functions , ‘Phr < e f c - °f one discrete 
argument t = jr £ ui T , so that £ Bh for all t = jr £ ui T . Let A^, 
8$, CffJ, ... be linear operators dependent on the parameters h and r 
and acting from Bh into Bh for every t £ lo t . For the moment, omitting the 
subscripts h and r we can write down y n = y(n,T) = y(t n ) = y, A(t), B(t ) 
and C(t). This should cause no confusion. 

We call a family of difference equations of order r — 1 

r— 1 

B o(*n) 2 /n+i = ^2Cs{tn)y n +i-s + /„ ■ n = r - 2 , r - 1 , r, . . . , 

5 — 1 

depending on the parameters h and r with operator coefficients B 0 , C 1 , . . . , 
C r - 1, which are linear operators acting in the space Bh and dependent on 
h and r, an r-layer operator-difference scheme or simply r-layer scheme. 
If the inverse operator B~ l exists, a solution y n+l of this problem can 
be expressed in terms of the initial vectors y 0 , y x , . . . and the right-hand 
side /. As usual, we assume all the vectors to be given and consider only 
two-layer and three-layer schemes 


(1) B 0 y n+l + B 1 y n = Ttp n , n = 0, 1,..., y 0 given, 

(2) B 0 y n + l +B lVn +B 2 y n __ l = np n , y 0 and y t given. 

3. The canonical form of two-layer schemes. Any two-layer scheme (1) can 
be written in the form 

(3) B(t n ) Vn+1 ~ Vn + A(t n ) y n = , 

n = 0, 1, . .. , y 0 £ B h given. 

Indeed, by comparing (1) with (3) we see that B — B 0 and A = ( B 0 + 
B j )/t. Within more compact notations 

y = y n = y(t n ). y = y n +1 = y(t n + 1 ) = y(t n + r ). 
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equation (3) can be recast as 

(4) By t + Ay = ip(t) , t = t n = n r £ tu T , y( 0) = y 0 E B h . 

We call both equations (3) and (4) the canonical form of two-layer 
schemes. Equation (4) is similar to the differential equation 

„ du , . 

e- + Au = m 


a. v‘ (x) f; 


Example 1 For the heat conduction equation 

du d 

•77 = Lu + f , Lit = — 

dt 

we made in Chapter 5 the design of the two-layer scheme with weights 
Vt = A (<t y + (1 - <t) y) + ip , kv = (a(x) v s )^ . 

With the aid of the the identity 


y-y 

y-y + T - = y+ry t 

T 

we reduce it to 

y t - vt ky t - ky = p . 

Comparison of this equation with equation (4) gives 


B = E + a t A , A = —A . 


This form of writing reveals what is meant by the canonical form of a 
weighted two-layer scheme. 

At the next stage we proceed to solve equation (4) with respect to 
V — y n +L- If th e inverse operator B'~ 1 exists, one can write down 

(5) y = S y + t p , S = E — t B~ l A , ip = B"~ l ip . 

The operator S is called the transition operator (from one layer to an¬ 
other). In addition to the canonical form (4), alternative forms of writ¬ 
ing will appear in the sequel for two-layer schemes: Bi) = C y + r <p or 
B y n+ i = C y n + t ip n) where C = E — r A, E being the identity operator. 
In the case B = E, scheme (3) is called an explicit two-layer scheme: 


yn-\-l Vn 

T 


+ A y n = An 


permitting us to determine the value t/ n+1 on the upper layer by the formula 
y n + i = y n — t A y n + r p n . If B E, then scheme (3) is called an implicit 

two-layer scheme. 
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4. The canonical form of three-layer schemes. We may attempt the three- 
layer scheme (2) in the canonical form 

( 6 ) B n+ 2 T “ A R(Vn+i — 2 y n + y n ~ i) + A y n = ip . 

By comparing (6) with (2) we see that such a writing is always possible if 
we agree to consider 

( 7 ) B = B 0 — B 2 , R = — ( B 0 + B 2 ) , A = — ( B 0 + B l + B 2 ) . 

Also, it will be sensible to introduce the notations 

y -y Vt- m y-2y + y 

y° = — . Vtt = -= - 2 — 

t l T T T a 

and regard the equation 

By° + t 2 Ry Tt +Ay = ip(t) , 

( 8 ) 

0 < t = n t £ UJ T , 2 /( 0 ) = y 0 , y(r) = Vl , 

to the canonical form of a three-layer scheme together with (6). 

Example 2 We now turn to the weighted three-layer scheme 


(9) yo + A a 1 y + ( 1 - a 1 - a 2 ) y + a 2 y j = ip 

and try to reduce it to the canonical form. With this aim, we make use of 
the formulae 


y = y + 


y = y- 


y-y , y-^y + y , , r 


y + T y° + ~2 Vtt > 


■y-y , y-2y + y , T 

— + -2- = y-ry 0t + Y y Tt 


/ ^ ^ , (o"i + a 2 ) t 2 

T iy + {i- cr i- cr 2)y + cr 2y = v + (- <u ) T y° +-^— 


Upon substituting these expressions into (9) we write the weighted scheme 
in the canonical form (8), where 


(10) B = E + t — a 2 ) A , 


R - \ () A . 



388 


Stability Theory of Difference Schemes 


The passage from (6) or (8) to (2) leads to the equation for determining 
the value t/ n+1 on the upper layer t = t n+i : 

(B + 2t R)y n+1 = 2r (2 R - A) y n + (B - 2tR) y n __ l + 2rip n , 

thereby clarifying that problem (8) is solvable if the inverse operator ( B + 

2 r7?) 1 exists. Moreover, the value y n+i can be expressed in terms of 
the values y n and y n _i on the preceding two layers. Therefore, two initial 
vectors y 0 and y x (or y 0 = t/(0) and y : = t/ t (0)) are required to be given 
in such matters. If B 0 = B + 2 r R = E is the identity operator, then the 
three-layer scheme (8) is said to be explicit; we thus have for it 

Vn +1 = 2r (27?- A) y n + (B - 2tR) y n _ l +2rcp n . 

In the case when B + 2 t R ^ E, scheme (8) is said to be implicit. 

Sometimes it may be useful to have at our disposal together with the 
canonical form (8) the three-layer scheme in the form (2) or 

(11) B yo +( E + t 2 R) t + A y = cp . 

This equation is obtained from equation (8) by the formal substitution of 
E/t 2 + R for R. 

5. The notion of stability. The notion of stability for three-layer schemes 
is of our initial concern. By a two-layer scheme we mean a set of operator- 
difference equations (4) depending on the parameters h and r. We pre¬ 
assumed here that the operators A and B are given on the entire space 

B h . 

As a matter of fact, we will consider the set of solutions {j/ ftT (t)} 
of Cauchy problem (4) dependent on the input data { tp hT (t )} and { y Qh }. 
Scheme (4) is said to be well-posed if for all sufficiently small r < r 0 and 
\h\<h 0 

(1) a solution of problem (4) exists and is unique for any initial data y oh £ 
Bh and right-hand sides <^ ftT (t) £ Bh for all t £ uq; 

(2) there are positive constants M 1 and M 2 independent of h and r and 
disregarding to the choice of y oh £ Bh and y> ftT (£) £ Bh such that for any 
t £ ui T for a solution of problem (4) the estimate holds: 


( 12 ) 


WVhrii + r )ll(U) 


< II Voh 11(1°) + 


max 
o <t'<t 


^(0ll(2 k ) 


where IMI(U). II -11(12) and || • ||( 2)i ) are suitable norms on the space Bh- 
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Inequality (12) expresses the property of continuous dependence which 
is uniform in h and r of the Cauchy problem (4) upon the input data. Here 
and below the meaning of this property is stability. A difference scheme 
is said to be absolutely stable if it is stable for any r and h (not only for 
all sufficiently small ones). It is fairly common to distinguish the notion 
of stability with respect to the initial data and that with respect to the 
right-hand side. Scheme (4) is said to be stable with respect to the 
initial data if a solution to the homogeneous equation 

(4a) By t +Ay = 0, t = nr> 0, y(0) = y 0 , 

satisfies the estimate 

( 12a ) II Vhrit + T ) ll( U) < M 1 II V0h 11(1°) • 

Scheme (4) is said to be stable with respect to the right-hand side if 
for a solution to equation (4) with the zero initial conditon y{ 0) = 0 

(4b) B y t + Ay = tp, y( 0) = 0, 

the inequality holds: 

(12b) \\y hT {t + T) || (u) < M 2 o max || w(0 ll (2k) ■ 

For later use, we approve for a solution y of problem (4) the decomposition 
y = yA) -p yA) t where yA) is a solution of problem (4a) and yA) is a solution 
of problem (4b). On the strength of the triangular inequality 

l|2/ftr(l + 0>ll (U ) < l|j/i J r ) (l + r )ll(l )l ) + l|j/ir ) (l + r )ll( U ) 

the combination of estimates (12a) and (12b) gives estimate (12). In a 
similar way it makes sense to introduce the notion of stability for three- 
layer schemes. However, in this case we are to consider the pair of vectors 
Y n . |_i = {y n , y n . |_i } with the norm of the special type 

(1°0 || Yn- (-1 ||. . || Vn ”b Vn + l IL,*\ II Vn-\-l Vn |L.**, ' 

where || ■ and || • H^**) al 'e suitable norms on the space Bh. Various 

norms of the type (13) appear, time and again, in the stability analysis of 
three-layer schemes by means of the energy inequality method (for more 
detail see Chapter 5, Section 6). 
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Thus, the three-layer scheme (8) is said to be stable if for any initial 
data y 0> y 1 and for any right-hand side <p(t) its solution satisfies the estimate 


(14) Y hT (t + r) 


'(U) 


< M, || Yhr (t) 


'( 1 £) 


Mr, 


max 
o <t'<t 


I Yhrit') 


'(20 


where M 1 and M 2 are positive constants independent of h and r and dis¬ 
regarding to the choice of y 0> y x and <p(t). 

The main problem under consideration amounts to the following one. 
Suppose that equation (4) is uniquely solvable with respect to y n+l for 
any y n and What are conditions on the operators A and B for a 

scheme to be stable in the sense of the above definition? In other words, we 
wish to establish sufficient stability conditions for scheme (4) and obtain 
a priori estimates of the form (12). Moreover, sufficient conditions should 
be convenient for practical verifications in the case of concrete difference 
schemes associated with equations of mathematical physics. 

In what follows stability of differential schemes will be given special 
investigation irrelevant to approximation and convergence. 

6 . Sufficient stability conditions for two-layer schemes in linear normed 
spaces. We now raise the question concerning sufficient stability condi¬ 
tions for two-layer schemes in linear normed spaces. In full details these 
investigations will be carried out in Section 2 for the case when Bh = Hh 
is a real Hilbert space. 

In what follows the Cauchy problem (1) is supposed to be solvable, 
that is, the inverse operator B“ 1 exists. Therefore, scheme (4) can be 
written in the form 


(15) f/n + l ‘~’ n yn ~b T fn > fn ^ n Yn i ^ 6, 1, ■ • • , Vo C Bf, , 

where 


(16) - S n = E — t B~ 1 A n 

is the transition operator. The operator S n depends on t n = nr, h and r, 
however, neither for S n nor for B nt A n , y n , and y 0 the dependence on 
h and r is explicitly indicated. 

By virtue of the recurrence relation (15) we find that 


Vn +1 ~ Tn +1 , oy 0 + y ] T 7n + l,i + l fj ) 

J=0 


( 17 ) 
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where 


-^n + l, J 


T n + 1,0 


Sn Sn — 1 • • • Sj 
Sn Sn— 1 • • • -Si Sq , 


Tn -f 1, n -f1 — Sj . 


The operator T n y ij is called the transition operator from the layer j to 
the layer n + 1, while the operator T n +i, o refers to the resolving operator. 
The triangular inequality yields 


(18) || 2 /„+il| (1) < II 3n+i, n || • || y 0 \\ (1) +Er\\Tn + i, ]+ i\\ ' WfjWyy 

where || • ||^ is any suitable norm on the space Bh, making it possible to 
arrive at the following assertion. 

Theorem 1 For the stability of scheme (15) it is sufficient that for any 
0 < j < n < n : 

(19) ll^ll < M,. 

Moreover, having stipulated this condition, the solution of the difference 
problem (3) satisfies the a priori estimate 


( 20 ) 


IVn + l 


'( 1 ) 


< M, 


I y 0 




■E r 
1=0 


B J 


'Pi 


E) 


for all 0 < n < n 0 . 

Note that estimate (20) implies (12) with constant M 2 = M 1 t 0 and 
II fj 11 ( 2 ) = II B j l fj ll(i) incorporated. 

Theorem 2 For the stability of scheme (3) it is sufficient that for the norm 
of its transition operator Sj the estimate 

(21) 11311 <l + c 0 r 

is valid for all j = 0 , 1, .. . , n 0 — 1 , where c. 0 > 0 is a constant independent 
of t and h. Moreover, under condition (21) a priori estimate (20) holds 
with constant Mi = exp {c 0 t 0 }. 
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To prove this assertion, it suffices to verify that estimate (21) implies 
estimate (19): 

II T n ,j || = || S n -1 S„- 2 • • • Sj + i Sj || 

<I|S„-1 II • l|5„- 2 || •' • II Sj + i || • || 5 j ||<(l + c 0 r)”-> 

< (1 + c 0 r) n < (1 + c 0 r) n ° < e c ° n ° T = e c ° to = Mi . 

Quite often, the reader can encounter the statement that “stability 
with respect to the initial data implies stability with respect to the right- 
hand side”. How is one to understand the nature of this assertion? 

We say that scheme (4) is uniformly stable with respect to the 
initial data if the Cauchy problem is stable: 


(22) 

Vn +1 ^' n Vn ‘ 

n = j,j + 1, • • • 

, Vj , j = 0, 1, ... ,n given 


for any j = 0, 

1 ,. .. ,n 0 - 1, 

that is, 

(23) 

11 ^ 11 ( 1 ) < M i 

||t/ y || ( i) for all 

0 < j < n < n 0 , 


where M 1 is a constant independent of r and h both. 

If the condition of uniform stability is satisfied, then estimate (19) 
holds true for the resolving operator T n j. Therefore, Theorem 1 asserts 
that estimate (20) is valid for a solution of problem (4). This type of 
situation is covered by the following results. 

Theorem 3 If scheme (4) is uniformly stable with respect to the initial 
data, then it is also stable with respect to the right-hand side under the 
condition of the norm concordance 

(24) |M| (2) = ||5-V|| (1) . 

Moreover, condition (24) assures us of the validity of a priori estimate (20). 

It is worth noting here that condition (21) is sufficient for uniform 
stability with respect to the initial data. 

The object of investigation is the two-layer scheme with constant op¬ 
erators A and B, not depending on t n = nr: 


(25) 


Vn +1 Sy n + ~ fr, ) f n B tp n , 

s = E — tB~ 1 A , 


n = 0, 1, .. . , 
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where y 0 is given. If a scheme with a constant transition operator S is stable 
with respect to the initial data, then it is uniformly stable with respect to 
the initial data, since 

(26) T nij =T n - ji0 = S n -’. 

Theorem 4 The stability with respect to the initial data of scheme (25) 
with constant operators is necessary and sufficient for the stability with 
respect to the right-hand side, provided condition (24) of the norm of con¬ 
cordance holds. Moreover, in that case a priori estimate (20) is valid. 

Sufficiency. The stability with respect to the initial data means the 
boundedness of the resolving operator 

(27) ||T ni o|| < Mm 

In accordance with what has been said above, this implies condition (19) 
and so it remains to use Theorem 1. 

Necessity. Let scheme (25) be stable with respect to the right-hand 
side, meaning the validity of the inequality for the solution of problem (4b) 

n 

(28) lk + il| (1) <Mi ^ r \\B- l ^\\ {iy n = 0 , 1 ,.... 

3 = 0 

This estimate holds true for any right-hand side /) = . This provides 

enough reason to conclude from (17) that 


(29) y» + i = X] TT n + i,3+if 3 ■ 

j=o 

The assertion will be proved if we succeed in showing that property 
(27) is true. Choosing r/y = we deduce from (29) that 

Vn +1 = T n + ipf = T n flf 

and 

lly„ +1 || (1) < lirn.oll • ||/|| (i) . 

On the other hand, (28) yields || S/n + i ll(i) ~ II / 1l(i) ■ Comparison of 
these inequalities gives (27), from which the stability with respect to the 
initial data immediately follows. 
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Summarizing, we draw some conclusions which will be needed in the 
sequel. 

1. When the transition operator happens to be constant, the stability 
analysis with respect to the initial data is mostly based on estimates of the 
norms of the transition operator. 

2. The condition of concordance between the norms of the right-hand 
side and the solution such as 

IMI (2) = I|5-VII (1) 

is a severe constraint. If || B~ l || < c 1; where cq > 0 is a constant indepen¬ 
dent of h and r, then || p ||^ < <q || <p ||^ and instead of (20) we obtain the 
estimate 

t 

(30) || y{t + r)|| (1) < Mi ||t/(0)|| (1) + M 2 r \\<p(t')\\ (L) , M 2 = Mi Cl . 

t'-0 

In Section 2 a priori estimates will be obtained for which condition (24) of 
the norm concordance is not required. 

3. Scheme (4) is stable if || 5) j| < 1 + c 0 r for all j — 0,1,... , ri 0 — 1. 
In practical applications of this sufficient stability criterion one needs to 
reveal some properties of the operators A and B ensuring condition (21). 
Such conditions are established in Section 2 of the present chapter. They 
asquire the form of linear operator inequalities for the operators A and B 
acting in the Hilbert space H n = B h . 

7. Approximation and convergence. The notions of approximation, conver¬ 
gence and accuracy for operator-difference schemes are introduced by anal¬ 
ogy with the corresponding notions for the operator schemes A n y n = <p n 
arising earlier in Chapter 2, Section 4. Only a few editorial changes will 
appear in this matter. For instance, together with the norms || • and 

|| • ||( 2fc -) it will be sensible to introduce the additional norms 

\\yhx( t n)\\(i hT ) = 0<( ““ <(n ll^ir(tn')ll(l k ) ) 

ll^r(t„)ll (2tr) = 0 < ( m^ (n ll^r(V)ll (2k) , 

which complement further stability analysis. 

Thus, let B h be a linear space with norms || • and || • on it. 

We denote by B and B^\ respectively, the resulting normed spaces and 
assume in the sequel that 

VhT^n) C &h ^ > V’hT^n) C Bh ^ 



Operator-difference schemes 


395 


for all t n = nr and that the operators of scheme (4) carry out B ^ into 


B 


{ 2 ). 


Ah ,B h :B 


O) 

h 


B 


( 2 ) 


Let Bg 1 ^ and Bg 2 ^ be normed spaces with norms || • and || • ||( 2o ); M (+ be 
an abstract Bo^-valued function of the argument t £ [0,T] and let f(t) be 
an abstract B^-valued function of the argument t £ [0,X]. Furthermore, 
we refer to linear operators a = 1,2, projecting Bg^ onto B ^: 


u h = 7+ } u e B [ h ] if £+, 
A=pf } /e4 2) if /efiW 


We take for granted the condition of the norm concordance 

^ (a) H( q'o) ’ where r/> (a) e i++a = 1,2 . 




IM-o 


Let yh T (tj) be a solution of problem (4) and u(t) be a continuous 
function of the argument t, so that 


u (t)\t=t 3 = u {tj) = ul • 

In such a setting the error z 3 hr = J/^ T — u 3 h needs investigation. We say that 
scheme (4) converges on an abstract function u(t) £ B + if 


lim max 
|ft| —► o,7-—► o o<j<j 0 


Ik 


3 

hr 




= o. 


Scheme (4) converges with the rate 0{\h\ m + T h ) or is of accuracy 
0(\h\ m + T k ) on an abstract function u(t) £ Bg ^ if 


max ||^ t _^|| <M(|/rr + k), 

0<3<3 o 1 h) 

where M = const > 0 is independent of h and r both. 

An a priori characteristic of a scheme is the error of approximation. 
The approximation error on a function u(t) for scheme (4) is known as the 
residual 

7 + 1 j 

U J J _ n J 

i’L = B hr ~ A ~~ t -- + A hT u 3 h - <p 3 hT , ip ] hT = iP(t 3 ,h,r). 
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Scheme (4) provides an approximation on a function u(t) if 

(31) max ||'i/Cjj .—>0 as \h\ —>■ 0, r —> 0. 

o<j<j o 1 h > 

Scheme (4) provides an approximation of 0(\h\ m + r fc ) on a function 
u[t) E if 

o <] a <- 0 H^IU) <M(|A| m +r fc ), 

where M = const > 0 is independent of h and r both. 

Along these lines, we may set up the problem for the error z 3 = y 3 —u 3 h : 

(32) B— - -+Az 3 =-ip 3 t j = 0,1,..., z° — y 0 — u° h . 

If scheme (4) is stable, then for a solution of problem (32) the estimate 
holds: 

lk J ‘ll (U) <M 1 || !/o -«“|| (U) +M 2 o max H^'H (2h) , 

thereby justifying the next assertions. 


Scheme (4) converges on a function u(t ) if it is stable , gen¬ 
erates an approximation on u(t) and the initial value y 0 
approximates the element u(0 ): 

WVohr ~ u 5!ll(U) —>° as 


Scheme (4) is of accuracy 0(\h\ m + r fc ) on a function -u(t) 
if it is stable , provides an approximation of 0(|/i| m + r k ) on 
u(t ) and 

\\yo~<\\ {lh) = o(\hr + T k ). 


In particular, u(t) may be a solution of a certain differential equation. 
In that case we say that the difference scheme approximates the difference 
equation, provided condition (31) holds, etc. 

We note in passing that one is to understand the statement “if a 
scheme is stable and provides an approximation, then it is convergent” 
given in Chapter 2, Section 2 as follows: both the difference equation and 
the initial value generate an approximation (if we accept y : — V^u(0), 

the n \\Voh T " ll (U) = 0). 
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6.2 CLASSES OF STABLE TWO LAYER SCHEMES 

1. The problem statement. We pursue the stability analysis of two-layer 
schemes by having recourse to their canonical form 

(1) Bu t + Ay = t = riT<Eui T , ?/(0) = y 0 . 

Let B h = H h be a finite-dimensional real space, ( , ) be an inner 
product and || x || = \/(z, x ) be the associated norm in the space H h . The 
operators A and B of scheme (1) depend, in general, on /i, r and t. Here 
and below, we agree not to indicate explicitly the dependence on t. 

The main goal of our studies is to find out sufficient conditions for 
the stability of scheme (1) and obtain a priori estimates for a solution 
of problem (1) expressing the stability of this scheme with respect to the 
right-hand side and the initial data. In preparation for this, a solution of 
problem (1) can be written as a sum y = y + y, where y is a solution to the 
homogeneous equation with the initial condition y(0) = y{0 ) = y 0 : 

Bu t +Ay = 0, t=Gw T , 2/(0) = %, 

and y is a solution to the nonhomogeneous equation with the zero initial 
condition: 

Bu t + Ay = <p(t), t=Gw T , 2/(0) = 0. 

The meaning of the estimate 

(2) \\y(t + r)|| (1) < Mi || 2 /(°)|| (1) 

of a solution of problem (la) is that scheme (1) is stable with respect to 
the initial data, while the estimate 

(3) \\y(t + r)|| (i) < M 2 max ||^(/ , )ll (2) 

of a solution of problem (lb) expresses the stability of scheme (1) with 
respect to the right-hand side. 

We will also use an alternative definition of stability of a scheme with 
respect to the right-hand side: 

(4) II y(t + r)|| (1} < M 2 max (|KOII (2) + IMOII (2 * } ) . 


where 
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When the triangle inequality 

\\y\\ (L) < IIj/ll ( i) + l|y|| (i) 

is put together with estimates (2), (3) and (4), we derive the a priori esti¬ 
mates 

(5) Mi + r)|| (1) < Mi ||t/ 0 || (1) + M 2 max \\<p{t')\\ (2) 
and 

(6) || y(t + r)|| (1) < Mi ||t/ 0 || (i) + M 2 max (||v?(OII (2) + IMOII^*)) • 

The forthcoming energy norms will be taken as the norm || • ||^ in 
addition to the approved basic norm || y || = \/(y, y)'- 

(7) \\y\\ A = \J(Ay, y) for A = A* > 0 , 

(8) IMI b = V(By,y) for B = B* > 0. 

Scheme (1) is said to be stable in the space Ha (or in H g) if estimate 

(5) is valid in the norm || • || (1) = || • (or || • ^ = || • || B ). 

2. A primary family of schemes. We will discover stability in a certain 
primary family of difference schemes. Before going further, we regard op¬ 
erators A and B to be bounded linear operators defined on the entire space 
Hh, £>(A) = T>{B) — Hh . In what follows the difference problem (1) is 
presupposed to be solvable for any input data y 0 and that is, there 

exists a bounded operator B~ l with the domain V{B~ l ) = Hh- For the 
sake of simplicity, we take for granted in the detailed account below that 

(1) the operators A and B are independent of t , that is, are constant 
operators; 

(2) B is a positive operator: B > 0; 

(3) A is a self-adjoint positive operator: A — A* > 0. 

Conditions (1)~(3) in combination with the solvability requirement 
single out a family of admissible schemes known as a primary family from 
the set of all possible schemes (1). Observe that condition 1) can be weak¬ 
ened in a number of different ways. Sometimes we will deal with operators 
A and B, which are dependent on t, that is, withA = A(t) and B = B(t). 

In the weighted scheme for the heat conduction equation in Example 
1 of Section 3 the operators A and B are specified by A = —A and B = E + 
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crrA. Since A < || A || E and E > A/ 1| A ||, we have B > (1/|| A ||+tjr)A > 0 
under the restriction a > — l/(r||A||). The operator A = A* > 0 is 
independent of t, so that conditions (l)-(3) are satisfied and the scheme 
concerned belongs to the primary family for a > —/i 2 /(4c 2 r), where c 2 = 
max a(x). 

x£oj h 

3. The energy identity. We study the problem of stability of scheme (1) by 
the method of the energy inequalities involving as the necessary manipula¬ 
tions the inner product of both sides of equation (1) with 2ry t = 2 (y — y): 

(9) 2r(By t , y) + 2r(Ay , y t ) = 2r(<p , y t ) . 


Using the formula 


( 10 ) 


y = 


y + y 
2 


y-y 

2 


\ (y + y) - t 2 vt 


we rewrite (9) in the form 

(11) 2 t((B - 0.5 rA)y t ,y t ) + (A(y + y),y- y) = 2r{<p,y t ). 
Lemma 1 Let A be a self-adjoint operator, then 

(12) (A(y+y),y- y) = {Ay,y) - {Ay,y) . 

Indeed, the chain of the relations 


{Ay,y) = (y, Ay) = ( Ay,y ) 

occurs due to the fact that A is self-adjoint operator and, therefore, 

(My + y),y-y) = (Ay, y) + (Ay, y) - (Ay, y) - (Ay, y) 

= (Ay,y) - (M,y) ■ 

Substituting (12) into (11) we obtain the energy identity for scheme (1): 

(13) 2 t((B - 0.5 rA)y t , y t ) + (Ay, y) = (Ay, y) + 2r(<p , y t ). 

4. Stability with respect to the initial data in Ha- Stability of scheme (1) 
with respect to the initial data is investigated with further estimation of a 
solution of problem (la). 
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Theorem 1 The condition 

(14) b > T 2 A 

is necessary and sufficient for the stability in H / 1 of scheme (1) from the 
primary family with respect to the initial data with constant M 1 = 1, that 
is, condition (14) is necessary and sufficient for the validity of the estimate 

(!5) 11%, IL < 11% IL > n = 1 , 2 ,... , 

where y n is a solution of problem (la). 

Sufficiency. Granted condition (14), the energy identity for problem 
(la) (with p — 0) 

(16) 2r((B - 0.5 TA)y t ,y t ) + (Ay,y) = (Ay,y) 
implies the inequality (Ay,y) < ( Ay,y ) or \\y\\ 2 A < \\y\\ 2 A , yielding 

llt/n + lIU < ll^nlU < ••■< ||!/oIL- 

Necessity. Suppose that scheme (la) is stable and estimate (15) is 
satisfied. We are going to show that this leads to the operator inequality 
(14), that is, 

(17) (Bv, v) > 0.5r (Av, v) for any v G H . 

We begin by placing identity (16) on the first layer (n = 0): 

2 t ((B - 0.bTA)y t (0) ,y t (0)) + (A Vl >Vl ) = ( Ay 0 ,y 0 ) . 

By virtue of (15) this identity can be satisfied only for 

2 t ((B - 0:5rA)y t (0) ,y t (0)) = (Ay 0 ,y 0 ) - ( Ay 1 ,yj > 0 , 


meaning 

(( B - 0.5rA)t/ 4 (0), y t (0)) > 0 . 

If % G H is an arbitrary element, then so is the element v = y t { 0) = 
— B~ l Ay 0 G H. Indeed, taking any element v = y t { 0) G H we find y 0 = 
— A~ l Bv G H for A -1 does exist. Thus, the inequality is met for any 
•u = y t { 0) G H, that is, the operator inequality (14) takes place, thereby 
completing the proof. 
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Remark 1 Condition (14) is sufficient for stability in the sense of (15) of 
scheme (1) if B = B(t ) > 0 is a non-self-adjoint variable operator. 

Remark 2 The fact that condition (14) is, in a certain sense, natural can 
be clarified a little bit by considering the simplest example relating to the 
difference scheme 


7 y ti -(-1 y n . r, ^ 

b -1- ay n = 0 , n- 0,1,, y 0 = M 0 > 

T 

where a and b are positive numbers corresponding to the differential equa¬ 
tion 


b + a u = 0 , f > 0, u(0) 

The difference equation yields 

t-i ^ ^ y I yn+i I — 

The stability requirement 


' I Vn 


\Vn + l I < 1% I 

is obviously satisfied if j 1 — ra/b\ < 1 or —1 < 1 — ra/b < 1, that is, for 
b > \ra. The similarity with the operator equation B > |ra is clear at 
the first glance. 

Example We now consider the weighted scheme 
Vt + A (ay + {1 - a) y) = 0 , 

whose use permits us to illustrate the effectiveness of the stability condition 
(14). For this, we ,write down this scheme in canonical form accepted in 
Section 1: 

(18) (E + cr t A) y t + Ay = 0 , B^E + arA. 

If A = A* > 0 is independent of t and cr > —l/(r|| A ||), then the weighted 
scheme belongs to the primary family (see Section 2). The necessary and 
sufficient stability condition (14) is of the form 

B — 0.5 t A = E + (cr — 0.5) r A > 0. 
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With the relations A < || A \\E and E > A/ 1| A || in view, we obtain 

B — 0.5 t A > (1/|| A || + (a- 0.5) r) A. 

The preceding inequality implies that condition (14) is equivalent to the 
constraint ^ 

a ° = 2 _ ■ 

This condition is necessary and sufficient for the stability of the weighted 
scheme, which interests us. 

In the case of a model heat conduction scheme 


Vt + A {?y + (1 - v) y) = 0 , A y = y Sx , 0 < X = ih < 1 , hN — 1, 
2 /( 0 ,t„)- 0 , 2/(l,t n ) = 0, y(z,0) - u 0 (x ), a; = ih e [0, 1], 

corresponding to the first boundary-value problem for the heat conduction 
equation 


du d 2 u 


dt~dx’^ ° < X < 1 ’ 


t > 0, 

m(0, t) = r<(l, f) = 0 , t>0, u(x, 0) = u 0 (x), 

we deduce that (see Chapter 5, Section 1) 


A = -A, 

|| A|| = ~ cos 2 


Ay = Ay 
it h 4 

~Y ~lA’ 


for y en h = H h> 

1 /i 2 

‘ 7o _ 2 “ 4 r cos 2 ^ ' 


The condition tr > a 0 , a 0 = /i 2 /(4r) > tr 0 , has been found in Chapter 
5 by the method of separation of variables. 

Suppose now the operator A > 0 not to be self-adjoint. Then scheme 
(18) does not belong to the primary family. However, it can be replaced by 
an equivalent scheme from the primary family. Since A > 0, there exists an 
inverse operator A~ 1 > 0, whose use with regard to equation (18) permits 
us to confine ourselves to 


B y t + A y = 0 , 


B = A -1 + a t E 


A = E. 
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The operator A = E = A* > 0 is independent of t and the operator B is 
positive for a > 0. Stability condition (14) in the space H^ = H takes for 
now the form B — \t A — A~ 1 + (tr — \)tE > 0, valid with tr > The 
condition cr > | is sufficient for the occurrence of the relation 

II y„ II < 11% II for tr > 0.5 , A*, A>0. 

5. Stability with respect to the initial data in Hq. Let us write down the 
second energy identity for scheme (la) assuming B also to be a self-adjoint 
operator; B = B* > 0. At the first stage we take the inner product of (la) 
and 2 r% 

(19) 2 t (B y t , y) + 2 t (A y, y) = 0 . 

Relying on the formulae 

1 , „ s T 1 T 

y=^{y + y) + ^y t > v = ^(y + y) - ^y t 

and making use of Lemma 1, we find that 

2 T(By t ,y) = (B (y-y),y + y) + r 2 (R%,%) 

= \\y\\l - II v\\ 2 b + 7 - 2 II vt IIb . 

2r(Ay,y) = ~ (A (y + y - t y t ), y + y + t y t ) 

= l\\y + y\\ 2 A -Y\\y t \\ 2 A - 

Substitution of these expressions into (13) leads to 

(20) \\y\\ 2 B +T 2 (||% ||| -0.5 r ||% |||) + 0.5 t || ?/+ t/1|| = ||y||| . 

Theorem 2 Let the operators A and B involved in scheme (1) be inde¬ 
pendent of t, A* = A > 0 and B* = B > 0. Condition (14) is sufficient 
for scheme (1) to be stable with respect to the initial data in the space H B 
with constant M 1 = 1. 

Indeed, let B > \tA ) then 

II Vt \\ 2 b ~ °-5 t ||% ||| = ((B - 0.5 r A) %, %) > 0 
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and relation (20) yields ||j/|| B < ||j/|| B , meaning 

\\y(t)\\ B < IIj/( 0)|| b . 

Remark If the operators A and B are commuting, then condition (14) is 
necessary and sufficient for the stability of scheme (la) in the space H B \ 

II Un Hu ~ II Vo Hu 

where D = D* > 0 is any operator commuting with A and B. This is 
acceptable if we involve, for instance, D = E, D = A 2 or D = B 2 for 
B = B* , so that || y n || < || y 0 ||, A\\y n || < A\\y 0 ||, S|| y n || < S|| y : ||, etc. 

6. Estimates of the norm of the transition operator. Stability considera¬ 
tions are connected with the use of a new method based on the estimation 
of the norm for the operator of transition from one layer to another. This 
method actually falls within the category of energy methods. 

We may attempt the difference scheme (la) in the form 

(21) y = Sy, S = E — t B~ l A , 

where S is the transition operator. Let D = D* be an arbitrary constant 
operator in the space H. With these, it is plain to show that 

(22) l|y|| fl = ll , ?y|| fl <11 s|| D • \\y\\ D , 

where || S \\ 2 D is adopted as the smallest constant M subject to the inequality 

(DSy,Sy) < M(Dy,y) . 

As can readily be observed from (22), scheme (21) is stable in the space H B , 
that is, || y n ||^ < ||t/ 0 ||^ if the norm of the transition operator does not 
exceed unity: || S ||^ < 1. This condition is equivalent to being nonnegative 
of the functional (M = 1) 

Jd[v\ - ( Dy,y) - ( DSy,Sy) > 0 . 

Of special interest is the case D = A, for which ||5’|| /1 < 1 for B > 
| tA. Indeed, upon substituting the expression for S into the functional J A 
we obtain 

Ja[v\ = {A y, y) — (AS y,S y) 

= (A y, y) - (A(E-tB~ 1 A) y, (E ~ t B~ l A) y) 

= 2 t (Ay, B~ 1 Ay) — r 2 (A B~ L Ay, B~ 1 Ay). 
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The outcome of further substitutions x = B 1 Ay or y = A 1 Bx is the 
same: 

(23) J A [y\ = J A [x\ = 2r [(Bx,x) - \t{Ax,x)\ . 

This implies that the conditions ||5'|| /1 < 1 and B > \tA are equivalent, 
providing support for the view that Theorem 1 holds. 

Since A = A* > 0, there exists a square root A 1 ! 2 = (A 1 / 2 )* > 0, by 
means of which the expression for J A [y] can be recast as 

J A [y\ = (A 1 l 2 y, A 1 l 2 y) ~ {A 1 ' 2 S y, A 1 ' 2 S y) 

= \\A L / 2 y\\ 2 ~\\A l / 2 Sy\\ 2 

= II A 1 ! 2 y || 2 — || (-E — t C) A 1 / 2 y\\ 2 , 
where C = A 1 ! 2 B^ 1 A 1 ! 2 . Substitution u = A 1 ^ 2 y gives 
JA[y\ = \\u\\ 2 -\\(E~rC)u\\ 2 . 

This implies that the condition 

(24) || £7 — tO || < 1 

is equivalent to the relation B > \tA. No assumption is made here that B 
is a self-adjoint operator. 

It seems worthwhile giving the special case when 

B = B* > 0, A = A* > 0 , 

for which the equivalence of the conditions 

(25) Jb[v]>0 and 5>0.5rA 

is certainly true. Since B = B* > 0, there exists B 1 ! 2 = (S 1 / 2 )* > 0 and 
this property is valid for the operator 

C = B 1 ! 2 A~ l B 1 / 2 , C = C*> 0. 

By applying successively the substitutions B~ l ! 2 Ay = x, C l ! 2 x — u, C = 
B 1 ! 2 A~ x B 1 ! 2 and B~ l l' 2 u = v we arrive at the chain of the relations 

J B [y] = 2 r(Ay,y) - r 2 (A y, B~ x A y) 

= 2 t{B 1 ! 2 x, A~ l B 1 ! 2 ) - r 2 (x, x) 

= 2 r (Cx, x) — t 2 (x,x) ~ 2t(u,u) — t 2 {C~ l u,u) 

= 2t(u,u) — r 2 {B~ x l 2 AB~~ 1 ! 2 u ) u) 

= 2r ([Bv,v) ~ ^ (4i),«)j . 
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Thus, the functional J b[v\ is transformed into the same form (23) as was 
done before for J a[v\- 

J B [y] = 2 t ((Bv,v) - ~ (A v, v)') , 


where 


v = B~ 1 ' 2 C 1 ' 2 B~ 1 ' 2 Ay , y — A~ x B 1 ' 2 C~ l ! 2 B 1 ' 2 v . 

This implies the equivalence of conditions (25), which assures us of the 
validity of Theorem 2. 

Therefore, the method of estimation of the transition operator norm 
permits us to prove that condition (14) is necessary and sufficient for the 
stability of scheme (1) with respect to the initial data in the space Ha (for 
B yf B*) and in the space Hg (for B = B* > 0) with constant M\ — 1. 

7. The method of separation of variables. If the operators A and B are 
self-adjoint 

(26) A = A* > 0 , B = B* > 0, 

then the stability of scheme (la) in the spaces Ha and Hg for 

B > \A 

can be proved by means of the method of separation of variables following 
established practice (for more detail see Chapter 5). 

Let N be the dimension of a finite-dimensional space H, X k be eigen¬ 
values and £ k be orthonormal eigenfunctions of the problem (see Chapter 
1, Section 1 and Chapter 2, Section 1) 

(27) Ai k = X k Bi k , k=l,2,...,N, 

where, in addition, (B £ k , fj m ) = 6 km ( 6 kk = 1 and 6 km = 0 for k ± m). All 
the eigenvalues X k of problem (27) are positive, because A > 0. 

In such a setting a solution of problem (la) is sought in the form 

(28) y(t) = J2 c k(t)£, k ■ 

k -1 

By virtue of the relations 


Ay 


N 

E c k A ik 

k -1 


N 


E E c k B E 


k = 1 
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we find upon substituting (28) into (la) that 

^{ c l(< + r)-M‘) +w<) } B(i = l) 

k = 1 

Putting this together with the orthogonality of the system {£*.} we arrive 
at 


~ ~ + ^k c k{t) — 0 j c k(t + r ) — (1 ~ T ^k) c k(t) i 

T 

N N 

y{t + r) - J2 c k( t + r )4 = XA " r X k) c k(t)Zk ■ 

k = 1 Ar = 1 

The norm || y(t + r) ||^ = (Ay(t + r), y(t + r)) can be most readily evaluated 
by observing that 

\\y{t)\\ 2 A = (E c k(t) x k B (,k > E c k(t)Zk) - E EcE)- 

K kzz 1 Jb = l 7 Jb = l 

All this enables us to deduce that 

\\y{t + T )\\ 2 A = E **^(* + 7-) < max (1-rAO 2 E A fc c *C) 

fc = l 1 <k<N k = 1 

yielding 

II y{t + U iu < I 1 - r\ k \ ||t/(t) E . 

Whence it follows that 


(29) 

if 


Hi/C + eiL < II^CIL < lli/( 0 )IL 


11 — -r Ajfcl < 1, k=l,2,...N. 

This condition provides support for the view that — 1 < 1 — rA fc < 1 or 
(30) 0 < X k < 2/r, l,2,...jV. 
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Let us show that inequalities (14) and (30) are equivalent. To this 
end, we operate with the expression 

N 

By -O.brAy = c k (t) {B 4 - 0.5 r A4) 

k = 1 
N 

= E ^)(l~0.5rA fc )54, 

k-i 

by means of which it is plain to calculate the functional 

N 

{By, y) - 0.5 r(Ay,y) = p(t)( 1 -0.5rA fc ). 

k = i 

Because of this form, the equivalence of (14) and (30) is obvious. 

We thus have shown that under conditions (26) inequality (14) is 
sufficient for the stability of scheme (la) in the space Ha, that is, relation 
(29) occurs. Let us stress that the requirement of self-adjointness of the 
operator B is necessary here, while the energy method demands only the 
positivity of B and no more. 

One can prove in a similar way the stability of scheme (la) in the 
space Hb, provided condition (30) holds. 

8. The p-stability condition. A more general definition of stability with 
respect to the initial data became rather urgent and extremely important. 

Let D = D* > 0 be a constant operator. Scheme (1) is said to be 
p-stable with respect to the initial data if for a solution of problem (la) the 
inequality holds for any y 0 £ H: 

(31) \\y„ IP < p n \\y 0 IP > 

where p = exp{c 0 r}, c 0 is a constant independent of h, r and irrelevant 
to the choice of y 0 .' If scheme (la) is p-stable in the space Hu, then it is 
stable in the same space Hd- 

II Vn Ip — || % Ip > Cl ~ nT — C 

with constants M i = exp {c 0 t 0 } for c 0 > 0 and M i = 1 for c 0 < 0. 

The two-layer scheme (la) with constant operators A and B can be 
reduced to the explicit scheme 

(32) —- + Ci„ = 0 or x n+1 =(E- T C)-x n , 



Classes of stable two-layer schemes 


409 


provided that the forthcoming substitutions are carried out before going 
further: 

1) x n = B 1 ! 2 y n for B = B* > 0, where C = C L = B~ 1 / 2 AB ~ 1 / 2 ; 

2) x n = A 1 ! 2 y n for A = A* > 0, where C = C 2 = A 1 / 2 B~ 1 A 1 / 2 . 

Definitions 1) and 2) together imply that 

\\ x n\\ = \\yn\\ B for C = Cl , x n =B 1/2 y n , 

IK II = \\Vn IL for C = C 2 , x n = A l ! 2 y n . 

The condition of /^-stability of the implicit scheme (la) in the space Hjj for 
the choices D = B and D = A is equivalent to the condition of /^-stability 
of the explicit scheme (32) in the space H: || x n || < p n \\ x : ||, n = 1,2,. ... 

Lemma 2 Let scheme (32) be given with a constant operator C. The 
condition of p-stability of this scheme is equivalent to the boundedness of 
the norm of the transition operator 

\\S\\ = \\E-tC\\< P . 

Indeed, we have x 1 — Sx : and J| a: x 11 < 11 5” 11 • ||x 0 || for n = 1. By 
comparing this inequality with (31) for n = 1 we finish the proof of Lemma 
2 . 

Lemma 3 If A = A* >0 and B = B* > 0, then the inequalities 

(33) 7i B < Ay 2 < B 7 i E < Cy 2 < E 

are equivalent for the operators C = B~ 1 ! 2 AB~ 1 ! 2 and C — A 1 ! 2 B~ l A 1 ! 2 , 

Proof Let C — B~ x l 2 AB~ X I 2 and 7 be an arbitrarily taken number. The 
difference 

(Cx,x) — y (x, x)'= (B- 1 / 2 AB~ 1 / 2 x, x) — 7 [x, x) ~ {Ay, y) — 7 {By, y) 

with regard to y = B~ 1 l 2 x shows that the signs of the operators C — 7 E 
and A — 7 B coincide. No property of positiveness of the operator A is 
required here. 

Let now C = A 1 I 2 B~ 1 A 1 I 2 . First, we are going to establish the 
equivalence of the inequalities C > 7 E {C < 7 E) and E > 7 C -1 {E < 
yC~ x ). Upon substituting y for C x l 2 x we obtain 

{Cx,x) ~y{x,x) = {C 1/2 x,C 1/2 x) -y{x,x) = {y,y) -y{C~ 1 y,y), 
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thereby justifying coinciding of the signs of the operators C — 7 E and 
E — pC~ l . We now insert A~ 1 I 2 BA~ 1 I 2 in place of the inverse C -i and 
accept v = A~ l l 2 y. The outcome of this is 

(Cx,x) - 7 (x, x) = (y, y) - 7 ( A~ 1/2 BA~ 1/2 y , y) = (An, v) - 7 (5n, n) , 

meaning that the operators C — jE and A — yB possess the same signs. By 
merely setting 7 = j 1 and 7 = y 2 we draw the conclusion that inequalities 
(33) are equivalent. 

Lemma 4 If the operator C = C* > 0 and r > 0, then the conditions 


(34) 

(35) 


||S'|| = l|£-rC'||<P, 

LaI e<c <^e 


are equivalent. 

Indeed, since the operator S = E — tC = S* is self-adjoint, 
|| S’||= sup | (Sai, ai) | = sup | ((£" — r C) x, x) | , 


so that 


or 


and 


we deduce that 


-||.sp7<s'<||sp; 

—pE < S < pE 
-pE < E — tC < pE , 


-—- E < C < E. 


In view of this, condition (34) implies condition (35). The converse impli¬ 
cation is simple to follow. 

Theorem 3 Let A and B be positive operators and A = A*, B = B* > 0. 
Then the conditions 


( 36 ) 


1 — O 1 “|~ p 

-- B < A < B 
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are necessary and sufficient: for the p-stability in the space Hg of scheme 
(la): 

II Vn ll B < P" 11% ll B • 

When, in addition, A is a positive operator, these are necessary and suffi¬ 
cient for the p-stability in the space 

\\Vn IL < P n 11% IU ' 

In order to prove this theorem, we beforehand reduce the implicit 
scheme (la) to the explicit scheme (32) with the operator C = B~ 1 ^ 2 AB~ 1 / 2 
(or C = A 1 I 2 B~ 1 A 1 I 2 for A > 0) and then collect the results of Lemmas 
3, 2 and 4. 

Remark One fails to prove Theorem 3 on account of the energy identity 
(20). However, the method developed in Section 6 may be of assistance in 
achieving this aim. In the case D = B conditions (36) are equivalent to the 
condition || E — tB~ x A || b < p or to being nonnegative of the functional 

J B [y] = p 2 (By, y) - (B (E -tB^A) y,(B-r B~ l A) y) . 

Suppose now that H is a finite-dimensional space of the dimension N. 
Substituting y = c k £fci where £ k is an eigenelement of problem (27), 

into the expression for the fuctional Jg[ y\ yields 

jb[v\ = ( p 2 - i 1 - rA t) 2 ) > ° for ^ ^ -y- > 

k — 1 

which is equivalent to condition (36). 

9. Stability with respect to the right-hand side. Recall that in Section 1 we 
have established a Theorem 3. This is a way of saying that the stability in 
the norm || • ||^ with respect to the initial data implies the stability with 
respect to the right-hand side taken in the norm || ^ 11 ( 2 ) = II -® _1< HI(i)- ^- n 
immediate implication of this is covered by the following assertion. 

Theorem 4 If condition (14) is satisfied, then scheme (1) from the primary 
family of schemes is stable with respect to the right-hand side and for a 
solution of problem (1) the a priori estimate holds: 

n 

\\y n +i 11.4 < 11% iu + r H 5 “Vfc IU ■ 

k~0 
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If, in addition, the operator B is self-adjoint, then 


II Vn + 1 I Is 11 2/o llfi “I" 'y y T II Vk I Is -1 • 

k -0 

What is more, a priori estimates (3) and (4) are valid with the mem¬ 
bers |MI (2) = IML- 1 and IMI( 2 ) = II V? 11- 

Theorem 5 Under the condition B > \tA , scheme (1) from the primary 
family of schemes is stable with respect to the right-hand side and for a 
solution of problem (1) the a priori estimate holds: 


(37) || y n+l 11^ < || y 0 IU + II <p 0 IL-i + X] r II T’ty lU-i • 

k = 1 

Proof In preparation for this, a solution of problem (1) can be arranged 
as a sum 

(38) y n = v n + w n , 

where w n is a solution of the equation (of the so-called “stationary” prob¬ 
lem) 

(39) Aw n =p n _ 1; n- 1,2,..., w 0 = w 1 . 

Upon substituting (38) and (39) into equation (1) a new problem arises for 
AU 

(40) B v t + A v = p, v 0 = y 0 -w 0 , 

where (p n = — rA)w t n and (p 0 — 0. In the estimation of v Theorem 4 

gives 

n 

(41) II v„+ 1IL < II y 0 \\ A + T T IIIU • 


A simple observation that 

w t = A-Vf, II A l l 2 B~ 1 (p || = || (E- tC) II 
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with C = A l / 2 B l A 1 / 2 enables us to evaluate the summand 
\\B~ L <p k \\ A = \\A l l 2 B~ l (p k \\ 

in inequality (41). Stability condition (14) has been used in Section 2 to 
obtain through such an analysis estimate (24) 

\\E-tC\\<1, 


implying that 


||A 1 / 2 £TV||<||A- 1 /Vf|| <11^11,4-1 • 

where the norm = \J ( A ~ 1 <f>f, <pf). Consequently, a solution of 

problem (40) satisfies the estimate 


II V n + 1 IL < IK IU + X] T H V’t.Jfe U- 1 > 

k = \ 

which in combination with the inequality 

II v o IU < II Vo IU + II w o IU = II Vo IU + II Vo IU - 1 

gives 

n 

II v n +1 IU ^ II y° IU + II vo U- 1 + T II wa U- 1 ■ 

fc=i 

Finally, by appeal to the triangular inequality from (38) we obtain (37). 
Thus, Theorem 5 is completely proved. 


Theorem 6 If the conditions 

(42) ' B > tA , B = B* 

are satisfied, then for scheme (1) from the primary family of schemes the a 
priori estimate holds: 

i _i_ n 

(43) \\y n+ i\\ 2 A <\\y 0 \\ 2 A + ^J2 T \\^W 2 B-" 


where £ > 0 is a constant independent of h and r both. 



414 


Stability Theory of Difference Schemes 


Proof The energy identity (13) is involved at the first stage. Estimation of 
its right-hand side 2 rlyp, y t ) is stipulated by successive use of the generalized 
Cauchy-Bunyakovskh inequality and the e-inequality 

2 r{<p,y t ) < 2 T \\p\\ B - l ■ ||t/ t || B < 2 re 1 )| y t ||| + IMI^-i . 

Upon substituting this estimate into (13) we obtain 

2 t (((1 - e x )B - | A) y t ,y^j + (Ay,y) < (Ay,y) + ~ \\<p\ B - l ■ 

If condition (42) is satisfied, the number £ x may be chosen so that 1/(1 — 
£j) = 1 + e, that is, e x = e/(l +e). Under such an approach we arrive at 

{l-e x )B- T -A = {\-e x )(B- X -^TA) >0, 

(Ay k+1 ,y k+1 ) < {Ay k ,y k )+ rlltpblll-, . 

Summing up the latter inequality over A; = 0,1,2,... , leads to estimate 

(43) . 

What are the conditions under which the stability in the norm 
II f 11(2) = II f II reveals itself? The following assertion answers this question. 

Theorem 7 Let the condition 

(44) B > e E + 0.5 t A 

be satisfied, where £ is a positive number, and scheme (1) belongs to the 
primary family of schemes. Then for a solution of problem (1) the a priori 
estimate holds: 

1 n 

(45) || y n+ 1 \\\ <\\yo\\ 2 A + T II Vk II 2 - 

k -0 

Proof With regard to identity (13) the Cauchy-Bunyakovskh inequality 
and the £-inequa.lity together give 

2 r(<p,y t ) <2t\\p\\ ■ \\y t || < 2T£\\y t \\ 2 + T^rlMi 2 - 
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Furthermore, we substitute this estimate into (13). Having stipulated con¬ 
dition (44), it follows from the foregoing that 


II < 


2 e 


m 


or 

II y 3 +1 111 < || v, 111 + ^ \W 3 II 2 . 

Summing up then over j = 0,1,. .. , n leads to (45). Thus, Theorem 7 is 
completely proved. 


Remark 1 Theorem 7 remains valid in the case of a variable operator 
B ~ B(t) and Theorem 2 continues to hold for a variable operator A = A(t). 
The reader is invited to verify these facts on his/her own with the aid of 
the proofs of the aforementioned theorems. 

Remark 2 If A = A*, B = B* > 0 and conditions (36) are satisfied, then 
scheme (1) is p-stable in the space H B with respect to the initial data, that 
is, a solution of problem (la) satisfies the inequality 

II Vn ll B < P" 11% ll B ■ 

On the strength of Theorem 3 in Section 1 this implies the following 
estimate for a solution of problem (1): 

n 

\\yn + A B <p n+l \\yo\\ B + Y. T P n ~ k \\^\\B~^ 

k -0 

It is worth noting here that the positiveness of the operator A is unnecessary 
in this matter. Apparently, this remark needs certain clarification. Let, for 
instance, A > —c t E and c t > 0. When this is the case, the condition 

A > B or A + f All B > 0 

r r 

can be met only for p = exp {c 0 r} > 1, that is, for c 0 > 0. Under the 
agreement B > sE, e > 0, we find that 

A + - - B > A + c : B > ( — c„ + c 0 e) E 

T 

and, therefore, 


if we accept c 0 > c t /s. To make sure of it, we may choose as B , for example, 
the operator 

B = E+tR, R = 0.5A', A' = A + c t E> 0. 

Then e = 1, c 0 = c t and p = exp {c t r}. 
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10. Stability of the weighted scheme. As an example of applying the 
theorems just established the weighted scheme comes first 

(46) y t + A (ay + (1 — a) y) - <p , y(0) = y 0 . 

Recall that in Section 1 scheme (46) has been already reduced to the 
canonical form 

(47) (E + a rA)y t + Ay = <p , y(0) = y 0 . 

By comparing (46) with (1) we see that B = E + arA. Suppose there 
exists an inverse operator A -1 . Applying A -1 to (47) reveals the second 
canonical form of the weighted scheme: 


By t + Ay = p, y( 0) = y 0 , 

(48) 

B = A L + a t E , A = E , <p — A l <p . 

In the sequel the form (47) is more convenient for the case of self-adjoint 
operators A and the form (48) - for the case of non-self-adjoint positive 
definite operators A = A(t). We will elaborate on this later. 

The first analysis is connected with the case when A is a constant 
self-adjoint positive operator A = A* > 0. As we have shown in Section 2, 
a necessary and sufficient condition for the stability of the weighted scheme 
(47) with respect to the initial data is 

^ - a ° ’ a ° = 2 ~ ■ 

Under this condition estimate (15) holds true for a solution of problem 

(47). In particular, for an explicit scheme (for a = 0) the condition a > tr 0 

implies r < 2/|| A 11, that is, an explicit scheme is stable in the space H& 

for r < 2/|| A 11. A scheme with r > | is unconditionally stable, that is, 

for any r. In Section 2.4 a model example with Ay = —Ay = —y Sx for 
0 

y G Qh = Hh has been considered in full details, in which (| A || < 4 /h 2 and 
the appropriate explicit scheme is stable for r < \h 2 . 

For the heat conduction equation with a variable coefficient k(x) we 
might have 



0 < k < c 2 , 


A y — (a(x) y x ) , 0 < a < c 2 , 

and tr 0 < 4 — h 2 /(4c 2 r), while an explicit scheme is stable for r < \h 2 jc. 2 . 
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Theorem 8 Let A be a self-adjoint positive operator independent oft = nr; 
A = A* >0. Then for the weighted scheme (47) estimate (37) is valid for 
tr > tro, estimate (43) for a > Tk£ __ e > 0, and estimate (45) 

for tr > tr £ , tr £ = 5 — ( 1 — e)/(r|| A||), 0 < £ < 1 , where a number £ is 
independent of h and t both. 

The above statements will be proved if we succeed in verifying the 
fulfilment of the conditions of Theorems 5, 6 , 7 with the aid of the inequality 

B ~ \ tA = E + (<r- I^tA > (p-|| + ( tJ “ \) T ) A - 

Suppose now that A = A(t) > 0 and A* yf A, that is, A = A(t) is a 
positive non-self-adjoint variable operator. 

Theorem 9 Let A — A(t) > 0 be a positive non-self-adjoint variable 
operator. If cr > 4, then for scheme (46) the estimate holds: 


(49) II Vn+\ II < 11 Vo II + II ("4 V)oll + ll( j 4 V),i II + ^2 t || (A V)qtll' 

k = 1 

Proof Consider scheme (48) with the right-hand side fp = A~ l p. When 
tr > the conditions of Theorem 5 are satisfied for this scheme and inequal¬ 
ity (37) applies here together with the established relations: j|j/||pp = ||j/|| 
and 

ll^-.fclU- 1 = II Tt,k II = II { A ~ lt f>)i,k II ■ 

As a final result we obtain (49). 

Remark If A* = A* (t) is a self-adjoint operator, then estimate (49) holds 
true for cr >cr 0 . 

Theorem 10 Let A(t) = A*(t) > 0 and tr > cr 0 . Then the following 
estimate is valid: 

(50) || y n+ 1 1 | 2 < || y 0 1 | 2 + +— ^2 t || ip k || 2 _! . 

£ i=i ' k 

Proof The energy identity (13) for scheme (48) takes for now the form 

(51) 2 r ((A -1 + (cr - 0.5 )rE)y t ,y t ) + || y || 2 = \\y\\ 2 + 2r (A~ l p,y t ). 
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The condition a > cr e implies that 

(52) B - T -A>sA~ Y . 

Indeed, for a > tr e 

B -^A = A~ L +(a ~ 0.5) tE 

= e A -1 + (1 — e) A -1 + (tr — 0.5) tE 
> £ A~ l + j 7 ~ 7 jr E + (a — 0.5) tE 

Mil 

= £ A~ 1 + (a — tr e ) rf? > £ A~ l . 

We have taken into account here that A -1 > f?/||A||. Substituting (52) 
into (51) we obtain 

(53) 2 re + \\y\\ 2 < || y || 2 + 2r (A~ V, y t ). 

The generalized Cauchy-Bunyakovskii inequality and the e-inequality to¬ 
gether yield 

(54) 2 r (A _1 q>, y t ) < 2r||v?|| j4 _ 1 ■ < 2 re 1111 ^~ IMI^- 1 ■ 

Substituting (54) into (53) we arrive at the relation 

lli/ll 2 < llyII 2 + 27ll<- 

or 

II 2/*+i 11“ < II yk II 2 2e H^llei^i ' 

Summing the preceding over k = 0, 1,2, . . . leads to estimate (50). 
Lemma 5 Let A be a positive operator for which the inequality 

(55) || Ax || 2 < A {Ax, x ), 

is valid with A = const > 0. Then 

A -1 > 4 E and A < AE. 

~ A 


( 56 ) 
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Indeed, putting x = A 1 y we obtain from (55) the inequality 
(y,y) < A (A~ l y,y), 

meaning E < AA _1 or A -1 > E/A. By virtue of the inequalities 
(Ax, x ) 2 < || Ax || 2 • || x || 2 < A (Ax, x) || x || 2 
we deduce that (Ax, x) < A|| x || 2 , giving A < AE. Lemma 5 implies that 
B = A -1 + crrE > (1/A + err) E, B — 0.5rA > 0 for a > a 0 , 
where A = E, a 0 = ^ — l/(rA). 

Lemma 6 Let A be a positive definite operator and inequality (55) hold. 


Then 


for a > cr n =- 

- 0 2 

1 

T A ’ 

(57) 

|| (5 +trrA )” 1 (5 - (1 -tj)rA) || < 1 

(58) 

|| (E + trrA ) -1 || < 1 

o' 

Ai 

b 


(59) 

| (5 + trrA )- 1 < ^ 

for tr > < 7 , =- 

- e 2 

1 — e 

T A 



0 < £ < 1 . 



Proof 1) Since B > \tA for tr > <r 0 , by applying Theorem 1 to scheme 
(48) we deduce that for a solution of problem (48) the estimate is valid for 
any y n £ H and ip — 0: 

(60) \\y n+1 || < \\y n || • 

As can readily be observed, scheme (47) for <p = 0 can be rewritten as 
Vn+i = Sy n , S = (E+ trrA ) -1 (E - (1 - tr) rA) . 

From here and relation (60) we obtain estimate (57). 

2) In order to estimate the norm ||5 _1 ||, where B = E + crrA, it 
suffices to establish an inequality of the form B > crE, tr > 0. Then 

'5|| a; l | 2 — (Bx,x) < || 5a; || • || a; || , || 5 x || > 6 || a; || , 

and, consequently, '|| B~ l || <1/6. If tr > 0, then B > E and || 5 _i || < 1. 
If tr > , then 

B > E + d E tA = E + 0.5 tA - A . 

In conformity with (56), A < A E, making it possible to conclude that 
B > E + 0.5 tA — (1— e) E > e E + 0.5 rA > e E 

and, therefore, ||5 _1 || < 1/e. Observe that estimate (58) holds true also 
for any non-self-adjoint operator A > 0, thereby completing the proof of 
the lemma. 
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Joint use of Lemma 6 and inequality (60) permits us to state the 
following. 

Theorem 11 Let A — A(t) he a positive operator and condition (55) hold. 
Then for scheme (46) with a > a e the a priori estimate 

( 61 ) II y(t + t) || < II 2/(0) II + ^ J 2 T II W II 

t '=o 

is true. If the following conditions 

1 1 

tj>0, cr>cr 0 , ^ 0=0 -T 

l T A 

are simultaneously satisfied, then estimate (61) is attained for s — 1. 

To prove this theorem, let us write down scheme (46) in the form 

Vn + i = Sy n +r5“V„ , 

where S = (E + <ttA)~ 1 (E — (1 — <t)tA) and B = E + ptA. Using the 
triangular inequality and estimates (57)—(59) behind, we obtain the relation 

WVn + l II <\\y n \\+^ || <p n ||, 
from which estimate (61) immediately follows. 

11. A priori estimates in the case of a variable operator A. So far we have 
established stability in H A under the agreement that operator A is constant, 
that is, independent of t. In the case when A(t) = A*(t) > 0 depends on 
t, this obstacle necessitates imposing the Lipschitz continuity of the 
operator A{t) in the variable t 

(62) | ((Aj(t) — A(t — r)) x,x\ < r c 3 (A(f — r) x, x) 

for all x G H, 0 < t < n 0 r, where c 3 is a positive constant independent of 
h and r both. 

A primary family of describing schemes is specified by the following 
restrictions: 


( 63 ) 


A(t) = A*(t) > 0 for all t £ii T , 
A(t) is Lipschitz continuous in t 
B(t) > 0 for all t £ Co T . 
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As before we assume the existence of an inverse operator 5 _1 (t), which 
assures us of solvability of problem (1) for any input data y 0 and <p(t). This 
family obviously contains the primary family introduced in Section 2.2. 

The method of energy inequalities shows in such a setting that the 
conditions 

(64) B(t) > 0.5 r A(t) for all t £ u> T , 

(65) B{t) > e E + 0.5 r A(t) for all t e w T , 0 < £ < 1 , 

turn out to be sufficient for the stability of scheme (1) with variable oper¬ 
ators A(t) and B(t). The norms || • || || • ||^_i themselves happen to be 

dependent on the variable t: 

II y IU = llylU (i ) = \J( A ( t )y,y) > • 

Therefore, it makes sense to speak about stability in the space H A (t) (in- 
stead of Ha) and H B ( t y 

The energy identity (13) with A — A(t) is the starting point in special 
investigations. To obtain a recurrence inequality, we should modify the 
expression 

(■ A y . y) = ( A(t) y(t), y(t)) = ( A(t - r) y(t), y(t)) 

+ ~ A{t ~ r))y(t),y(t)) 

and estimate the second summand on the right-hand side with the aid of 
inequality (62): 

(A(t)y(t),y(t)] < (1 + rc 3 )(A(f - r)y(t),y(t)) . 

Upon substituting this estimate into (13) we obtain the energy inequality 

(66) 2r ((B(t) - 0.5 r A(t)) y(t),y(t)] + £(t + r) 

< (! + TC 3 )£(t) + 2r (<p(t),y(t)) , 

where 

£{t + t) = (A(t) y(t + r), y(t + r)) = || y(t + r)||^ (J) . 

Inequality (66) with the member <p = 0 implies that 

(67) £(t + t) < (1 + r c 3 ) £(t ) < e Cs *£(t) for t>T, 
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provided condition (64) holds. The energy identity for t = 0 admits the 
form 

2r ((5(0) - 0.5 t.4(0)) y(t),y(t)) + £{t) = ||l/(0)||^ (o) + 2r (<p(0), t/ t (0)) . 
With conditions (64) and <p = 0 in view, we deduce from here that 

( 68 ) £(r)<||l/( 0 )|| 2 (o) . 

Collecting (67) and ( 68 ) with regard to problem (1) with <p = 0 we establish 
\\y(t + r)\\ 2 A(t) < Ml \m\\ A(0) , Mi = e 0 ' 5 C3 *° . 

Such a reasoning discovers actually only one essential difference be¬ 
tween the cases of variable and constant operators. 

We now summarize the above results in some aspects as the analogs 
of Theorems 5 and 7 that furnish the justification for what we wish to do. 

Theorem 12 Let operators A = A(t) and B = B(t) be dependent on t 
and conditions (63) and (64) be satisfied. Then for scheme (1) we have the 
estimate 

(69) ||2/„+ill >ln < Afi 

( n n 

ClklL + ll»>.IL-. + lk.ll,;. + E UK/t-VgJ,,}, 

k — 1 

where M\ = exp {|c 3 'f 0 } and A n = A(t n ). 

If c 3 = 0, then the operator A is independent of the variable t and 

(69) becomes (37) on account of the equality 

IM'VtlU = IIvtIL- • 

Theorem 13 Let operators A = A(t) and B = B(t ) be dependent on t 
and conditions (63) and (65) be satisfied. Then for scheme (1) we have the 
estimate 

1 n 

(70) Ik +1 ||^ < Ml {|k||^ o + Y E HI <Pk II 2 }, Mi = e 0 5 c 3*o. 

k = 0 

Estimates (37) and (45) are obtained for the case of constant operators 
A by merely setting M\ = 1 or c 3 = 0. 
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12. Example. In order to apply the general stability theory for particular 
difference schemes, one needs to perform several manipulations: 

• to reduce a two-layer scheme to the canonical form (1), that is, to 
specify the operators A and B involved; 

• to introduce the space Hh of all grid functions and reveal the de¬ 
sirable properties of the operators A and B such as positiveness, 
self-adjointness, etc. as operators acting in the space H 

• to verify whether or not the scheme belongs to the primary family 
of schemes as well as the fulfilment of sufficient stability conditions 
(64) or (65); 

• if the preceding conditions are satisfied, the scheme at hand is stable 
and a priori estimates hold for it such as, for example, (69) and (70). 

The first step within this framework is to reduce a scheme to the 
canonical form, but the above sufficient conditions provide a real possibility 
of writing stable difference schemes immediately in canonical form. 

We cite here only one possible example which helps motivate what is 
done. Those ideas are connected with the heat conduction equation 


du 

d 2 u 

O 

A 

~di = 

7 ^- , 0 < x < 1, 

(x,0) 

II 

O 

'sT 

o 

ii 

o 

ii 

'Is" 


and associated asymmetric scheme which is given on the grid 


u hT =u h xu> T , 

Q h = i x i = 0 < i < N] , Q T - {tj = jr, 0 < j < j 0 } , 

and asquires the form 

(71) Vi j + 1 . Vi — 1 j + 1 d" (1 ^0 Vi — 1 j h - ^ ^0 yi,j ) ’ 

LO CX. 

where ui = h 2 /r and a is a parameter. 

We do follow established practice in a step-by-step fashion. 1) Re¬ 
duction of the scheme which interests us to the canonical form. Denoting 
Vi,j = Vi an d Ui,j+ 1 = Vi we fi rs t rewrite (71) as 


(72) (w + a)yi = ay i _ 1 + (1 - a)y i _ 1 + y i+1 - (2 - to - a) Vi . 
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After that, taking into account that 


Vi—l ^ Vx ,i T Vi ) Vi -(-1 ^ Vx t i T Vi ) ^ Vx ,i ^ Vx ,i ^ ICrc ,i > 

Vi-i = 2/i-i + = 2/i-i -hVx.i + T Vt,i - h TVxt,i . 

substituting these expressions into (72) and omitting the subscript i, we 
come to 


(73) uj ry t - h 2 y sx - ahTy st . 

Dividing (73) by h 2 generates 

( 74 ) Vt + ~Y Vxt = Vsx ' 

0 

2) Let 77ft be the space of grid functions h (see Examples 1 and 2 

in Chapter 2, Section 4.1) defined on the grid uj h = {a^ = ih,0 < i < N} 
under the inner product structure (y, v ) = Vi v i h- In conformity with 

the results obtained in Section 4.1 of Chapter 2, the operators Ay = —y Sx , 
and Riy = 4 y s involved in the scheme are positive definite: (Riy,y) — 
ji(Ay, y). The operator A is self-adjoint, || A || < 4/k 2 . 

3) The operators A and Ri are constant. Because of this, it will be 
convenient to write scheme (74) in the form 

(75) {E + ar Ri)y t + Ay = 0, 


so that B — E + c\tR\. 

The condition B > 4 tA is satisfied for a > 1 — 2/(r|| A||). Indeed, 
for any x £ H 


((B — ORt A) x,x) = ((E + ct t R\ —0.5 t A) x,x) 
— ((E + 0.5 r (a — 1) A) x, x) , 


yielding 


5-0.5rA> A+0.5r(«- 1)A> (pfj + °- 5 r ( a ~ 1))^> 0. 

4) Since |J A|| < 4 /h 2 , scheme (71) is stable in the space H / 1 (in the 
grid norm of the space Wj) for 
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Together with scheme (71) one can write down one more asymmetric 
scheme which after reducing it to the canonical form becomes 

(E+ a t R 2 )y t + Ay = 0 , R 2 y = -^y x . 

Since (Riy,y) = ( R 2 y,y )> this scheme is stable under the same condition 
(76). Condition (76) shows that the asymmetric schemes are uncondition¬ 
ally stable for a > 1. 

13. The case of a skew-symmetric operator A. The main results of stability 
theory for two-layer schemes 


B y t + A y = <p 

have been obtained under the agreement that A = A* > 0 is a positive 
self-adjoint operator, while the operator B > 0 may be, generally speaking, 
non-self-adjoint. An exception is a weighted scheme in which the operator 
B is of the special type B = E + cftA and A* ^ A. 

Assume that A is a non-self-adjoint operator with the approved de¬ 
composition A — Aq + Ax, where Aq = |(A + A*), A L = |(A — A*), 
A* 0 = Ao, A* = — Ai, that is, Ai is a skew-symmetric operator, 

(Ait/, v) = ~{y,Aiv) 

and 

(A x y,y) = -(t/, Ait/) = 0 . 

To avoid generality, for which we have no real need, we restrict our¬ 
selves here to the case when A = Ai is a skew-symmetric operator involved 
in the weighted scheme 

y t + AyW = 0 , 

where A* = —A, (At/,t/) = 0, t/ ff ) = cry + (1 — cr)y, and attempt it in the 
form 

B y t + Ay = 0 , B = E + a t A . 

Since A and B are non-self-adjoint operators, we cannot use the obtained 
results of the general theory, so there is some reason to be concerned about 
this. With this aim, we proceed to develop a new approach in such matters. 
Observe, first of all, that 


(By,y) = (y + (tt Ay,y) - (y,y) + a t (Ay,y) = \\y || 2 , 
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that is, there exists an inverse operator B~ l . By inserting y = B~ l x it is 
plain to establish the relations ||5~ 1 a;|| 2 = ( B~ 1 x,x) < ||.B~ 1 a;|| ■ 11 re 11, 
giving, || B~ l x || < || x || and || B~ x || < 1. The next step is to rewrite the 
scheme in the form 

By = By - r Ay , y = y-rB~ 1 Ay, 
and calculate the inner product 

(By,y) = (By,y) - t {Ay, y) - r {By, B~ l Ay) + r 2 {Ay, B" 1 Ay). 

For later use, it will be sensible to represent the operator B in the form 
B = E + a t A = {E — cr t A) + 2cr t A — B* + 2cr t A 
and make the obvious transformations 

{By, B~ 1 Ay) = {B*y, B~ l Ay) + 2a t {Ay, B~ l Ay) 

= {y, Ay) +2ar{Ay,B~ 1 Ay) 

= 2a t {Ay, B~ l Ay). 


As a final result we obtain 

II y \\ 2 = \\y \\ 2 - {2a - l)r 2 {B~ l Ay, Ay) , 

yielding 

l|t/||<IMI if cr > 0.5 , 

||r/|| 2 <||r/|| 2 + (l-2 ( T)r 2 ||A|| 2 • || y || 2 < (1 + c 0 r) || y || 2 
or 

l|y|| < p\\y\\ . P — e°' 5c ° T , c 0 = (1 - 2<t)c 2 , 
if cr < i and r || A || 2 < c 2 . 

We have obtained through such an analysis the following estimates for 
the norm of the transition operator: 

|| S’ || < 1 for a > 0.5 , 

l|5’||</ 9 f° r cr < 0.5 and r||A|| 2 <c 2 . 
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This implies the estimate for a solution of the nonhomogeneous equation 
By t + Ay = <p\ 


\\Vn+l II < P\\ Vn II + T \\<Pn II < P^WVo II + J2 T ^ ^ II ■ 

k = 0 

Let now H be a complex space and B be a non-self-adjoint operator. 
Then a necessary and sufficient condition for the stability in the space H A 
with respect to the initial data of the scheme 

B y t + Ay = 0 


is of the form 


B 0 = ReB > 0.5 r A, A = A* > 0, 
where Bq — ^ (B + B*) — Bq . In particular, the scheme 
iy t + Ay = 0 , A = A* > 0 

is unstable in the space H Al since B = iE and Re B = 0. However, 
A! = — iA is a skew-symmetric operator (A')* = —A' and, as stated before, 
this scheme is conditionally stable in the space H: 

WVn + i II < P n+ 1 \\y 0 \\, P = e c ° T , c. 0 =c 2 ifr||A|| 2 < c 2 . 

0 

In the case of the Schrodinger equation Ay = —y$ x> V G flh[0, 1], we have 
|| A || < A/h 2 and the restriction on r takes the form 

h A 

T < - C , . 

- 16 2 

which is improper for parabolic equations. However, the weighted scheme 

iy t +Ay ( ^=: 0, A = A* > 0 , 
will be stable in both spaces H A and H for a > If so, 

Bo = Re B = cftA > ^ r A 

and 11 y n 11^ < ||i/ 0 ||^. O n the oil 161, hand, in dealing with the skew- 
symmetric operator A' = — iA we get the estimate || y„ || < || y 0 || for a > 
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6.3 CLASSES OF STABLE THREE-LAYER SCHEMES 

1. The problem statement. In this section we establish sufficient stability 
conditions and a priori estimates for three-layer schemes on the basis of 
their canonical form 

Bye + r 2 Ryu + Ay = <p(t ), 2/(0) = y 0 , y(r) = y x , 

( 1 ) 

0 <t~r,T<t 0 , n = 1,2,... , n 0 — 1, f 0 = n 0 r. 

Here and below, y 0 and y 1 are arbitrary given vectors of a finite¬ 
dimensional real space H, tp(t) is a given arbitrary abstract hf-valued func¬ 
tion of the variable t G w T ; A, B and R are linear operators in the space 
H. The dependence of y(t) - y hT (t), <p(t) = <p hT (t), A(t) = A hr , B, R, y 0 
and y x on h and r is not explicitly indicated. We proceed as usual. This 
amounts to introducing more compact notations: 


y-y{t„) = y„, y = y(t n + r) = y n+1 , y = y (t n - T ) = y n _ 1 , 
y t = (y-y)/T, yt = (y-y)/T, y° = (y - y)/(% r), 

Vu = (y-2y + y)/r 2 , 

allowing a simpler writing of the ensuing formulae. 

All the tricks and turns remain unchanged by analogy with Section 2: 
first, a solution of problem (1) can be arranged as a sum y = y + y, where 
y is a solution of the homogeneous equation: 


By 0 + t 2 Ry it + Ay - 0, y(0) = y 0 , y(r) = y x , 

(la) 


0 < t = nr < t 0 , 

and y is a solution of the nonhomogeneous equation with the zero initial 
data: 


(lb) 


Bye + r 2 Ry it +Ay= <p(t ), y(0) = y(r) = 0 , 

0 < t = TIT < t 0 , 


Second, an alternative form of writing appears useful: 


( 2 ) 


{B + 2 tR) y n ^i — , 

$ n = 2 (2 R - A) ry n + (B - 2 tR) y n _ 1 + 2 rip n 
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(A, B and R are, in general, variables, that is, they depend on t n ). From 
such reasoning it seems clear that problem (1) is solvable if an inverse 
operator (B + 2ri?)" 1 exists. In the sequel this condition is supposed to be 
satisfied. Moreover, we take for granted that 

(3) the operator B + 2 tR is positive definite. 

Further development of the three-layer scheme (3) is connected with 
the functional known as the compound-norm: 

(^) II Yn + 1 II 4 II Vn “h 2/ri -f-111 r ,) + 1 ^ n H(I 2 ) 5 

where || ■ and || ■ are suitable norms on the linear system H. 

In order to understand the structure of this norm a little better, it is ap¬ 
propriate to introduce the space H 2 = H © H being the direct sum of two 
copies of H. The space H 2 is defined as the set of all vectors of the form 

y = {y (1) + y {2) ) e h 2 , e h , a =1,2, 

where the operations of addition of vectors and multiplication of a vector 
by a number are carried out in a coordinate-wise fashion: 

Y + Y = {yW + y^ 1 ), y( 2 ) + y( 2 )}, a y = { a Y {l \aY {2) }. 

The norm on the space H 2 is natural to be defined by 

ll^l| 2 = l|y (1) ll( ll) + ll^ (2) ll ( 2 l2) - 

In our case the vector 



p assesses the coordinates Y^ x - \{y n+1 +y n ) and Y^ y = y n+1 -y n . It is 
easy to see that functional (4) satisfies all the axioms of the norm, namely 
||ay n+ i|| = M||y n+ i||, ||y n+ i|| > 0 for any y n e H, y n+1 E H and 
II Yn + i || = 0 only for y n = y n+l - 0; || Y n+X + Y n +i || < || Y n+i || + || Y n + i ||. 

We now in a position to define the notion of stability of scheme (1). 
The three-layer scheme (1) is said to be stable if there exists the norm (4) 
and for all sufficiently .small r < r 0 and \h\ < h 0 one can point out positive 
constants Mi and M 2 independent of r, h and disregarding to the choice 
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of y 0 , y lt <p(t) such that for any y 0) y lt <p(t) and all t — r, 2r, . . ., (n 0 — 1 )r 
a solution of problem (1) satisfies one of the following estimates: 

(5) lin* + r)||(i } <Mi||y(r)|| (0 

+ M 2 max ||^(f , )ll( 2 )- 

(6) ||^ + 0|| (1) <M 1 \\Y(t)\\ ( i0) 

+ M 2 ^max (||y(0ll(2) + ||<£>t“(0ll(2)) , 

where || • || 2 is some suitable norm on the space H, \\Y(t + r )ll( 1 ) and 
||y(r)|]( 1 ° ) are defined by the formula of the form (4), so that 

(7) || Y(t + r)||^ = - || y(t + r) + 1/(011^-, + \\y{t + r) - y(t )||^^ , 

(8) ||f / (r)||^ 1 o ) = - 11 y\ + 2/oll(iO) + 112/i — ?/oll(io } , 

where || ■ and || • are suitable norms on the space H. 

As far as constant operators A and R are concerned, the norms ||y||^ 
and ||y|| 0) normally coincide. In the general case ||Y(t + r )||( 1 - ) and 
IIy( 0II( 2 ) depend on t = nr, so that one should write \\Y(t + r)!^ ^ instead 
of ||Y(f + r)||( 1} and ||^(f)|| (2 t) instead of ||^(f)|| (2) . 

As we will see later, the norms || ■ 11^^ and || ■ are energy norms 
constructed for the operators A and R. For this reason we will assume that 
these operators are 

(9) self-adjoint: 

(10) positive: 

if if is a Hilbert space. 

2. The basic energy identity. We will carry out the derivation of the energy 
identity for the three-layer scheme (1) with variable operators A = A(t), 
B = B{t) and R = R(t). This identity is aimed at achieving a priori 
estimates expressing the stability of a scheme with respect to the initial 
data and right-hand side. 

By virtue of the relations 

11 1 
y=^{y + y)-^{y-^v + y)=^(y + y)-Y y » 


A = A\ R = R*, 
A> 0 , R> 0 , 
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we represent scheme (1) in the form 

B yo + t 2 (r - | A) y it + \ A(y + y) = <p , 

(11) v ' 

y{ o) = y 0 . y( T ) = yi, 

where A = A(t n ) = A n , B = B(t n ) = B n and R — R(t n ) = R n - Taking 
the inner product of (11) and 2rt/o = r(y t + t/f), we find that 

(12) 2 r (Byo,yo) + r 2 ((R - \ A) (y t - y t -),y t + y^ 

+ ^ (A(y + y),y - y) = 2 r (<p, y*). 
Let A and R be self-adjoint operators. Then 
R- 0.5A= (R- 0.5 A)*. 

By Lemma 1 of Section 2 we thus have 

(! 3 ) ((-R- \a) (y t - yt),y t + Vt) = \ A ) (vuVt) 

- (^(R— \A) (yt,Vi ) , 

(14) (A(y+ ij),y - y) = (Ay,y) - (Ay,y). 

At the final stage we add and subtract (Ay, y) on the right-hand side of 

(14) . The outcome of this is 

(15) (A (y + y),y-y) = [(Ay, y) + (Ay, y)] - [(Ay, y) + (Ay, j/)] . 
Lemma 1 Let A = A* be a self-adjoint operator. Then 

(16) (Av, v) + (Az, z) = 4 (A(v + z), v + z) + 4 (A(v - z), v - z) 
for any vectors v and z of the space H. 

Proof Since A = A* , we have (Av, z) ~ (v, Az) = (Az, v) and 
((A(w + z), v + z)) + ((A(v - z), v - z)) 

= [(Av, v) + 2 (Av, z) + (Az, z)\ + [(Av, v ) - 2 (Av, z) + (Az, z)\ 

= 2 [(Av,v) + (Az,z)] . 
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By inserting in (16) v = y and z = y we transform (15) into 

(17) {A(y + y),y - y) =0.5 [(A(y + y), y + y) + (A(y - y), y - y)] 

- 0.5 [(A(y + y),y + y) + {A(y -y),y- y)] . 
We now substitute (17) and (13) into (12) and take into account that 
{A{y - y),y - y) = r 2 (Ay u y t ), y- t - (y - y)/r = y t , 

(A(y -ij),y-y) = T 2 {Ay- u y { ) , 

making it possible to establish the basic energy identity for the three-layer 
scheme (1): 

(18) 2 r (Byo,yo) + (A(y + y),y + y) + t 2 ((R - \ A) y u y^ 

= \ {A(y + y),y + y) + r 2 ((i?- ^ A) +2 T (<p, t/=). 

In giving it we preassumed only property (9) concerning the self-adjointness 
of the operators A and R and no more. 

3. Stability with respect to the initial data. Recall the definition of stability 
with respect to the initial data and the right-hand side. Scheme (1) is said 
to be stable with respect to the initial data if for problem (la) the a priori 
estimate holds: 

(19) ||y(t + r)|| (1) <M 1 ||y(r)|| (1 „ ) . 

Scheme (1) is said to be stable with respect to the right-hand side if for 
problem (lb) the estimate 

(20) 1|y(f + r)|| (1) < M 2 max ||<p(f')l (2 ) 
or the estimate 

( 21 ) \\Y(t + r)|| (1) < M 2 + ||<p t -(OI (2) ) 

holds. 

Making use of the triangle inequality and collecting (19) and (20) or 
(21), we obtain estimate (5) or (6). 
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In our basic account A and R are taken to be constant self-adjoint 
positive operators and B refers to a non-self-adjoint nonnegative operator: 

(22) A = A*>0, R=R*> 0, B> 0. 

These restrictions permit us to specify and extract a. primary family of 
schemes. 

With the regard to problem (la) identity (18) takes the form 


(23) 

2 T (By. , y.) 

+ ||y(t + r)|| 2 = ||y(t)|| 2 , t = nr, 

where 



(24) 

im + m 2 

= \ (Myit + t) + y(t)), y(t + t) + y(t)) 



1 

+ 

(25) 

II mil 2 

= i ( A (y(t) + y(t - r)), y(t) + y(t - r)) 


+ r2 ( ( R - i A ) y?, Vi) ■ 

To avoid cumbersome calculations, we will also use index denotations by 
setting Y(t + r) = Y n + i and 

\\Yn+l IP = ^ (A(y n +1 +y n ),y n + 1 +?/„) + T 2 ((i?- \A) y tin ,Ut,n) 



Observe that relation (24) implies that || Y(t + r) || 2 > 0 for any y(t) ^ 
0, y(t + r) 0, provided that the operators A and R — A/ 4 are positive, 
A > 0 and R > A/4. 

Theorem 1 Let A = A* > 0 and R= R* > 0 be positive operators. Then 
the conditions 

(26) B = B(t) > 0 for all t E lu t , 

(27) R>{A 

are sufficient for the stability of scheme (1) with respect to the initial data. 
Under conditions (26) and (27) for problem (la) the estimate holds: 


(28) 


II Y(t + 7") || < || Y(t) || 



434 


Stability Theory of Difference Schemes 


where || Y || is defined in accordance with rule (24). 

Indeed, for B > 0 identity (23) implies that 

II Y{t + r) || 2 < || Y(t) || 2 , || Y(t + t) || < || Y(t) || < • • • < || Y{t) || . 

Remark 1 Theorem 1 holds true under the constraints 

R>\A, A > 0. 

However, in that case ||y|| may fail to be a norm, but it is always a 
seminorm. 

Remark 2 The three-layer scheme (la) can be reduced to the two-layer 
scheme 

(29) BY t +AY = 0, 7„ £ f/ 2 , 

where Y = Y n £ H 2 1 Yt = (Y n +1 — Y„)/t, A and B are operators in the 
space H 2 . This can be done using the vector 

Yn { 2 (9"" Hn~ 1 ) i Vn Vn~ 1 } 

and treating the operators A and B as operator matrices with elements 
being operators in the space H: 

/A 0 \ / B + 0.5 tA t(R-\A)\ 

\0 i?-W \-r(i2-lA) UR-*A)) 

If A — A*, R — R *, then the operator A : H 2 ->■ H 2 is self-adjoint: 

A = A*, while the operator B is non-self-adjoint. All this enables us to 
conclude that 

\\y\\ 2 a = ( ay,y) = (ayV\y (1 ))+((r- |d)y( 2 ),y |2 )] . 

In addition, we have A > 0, provided that A > 0 and R > ~A. 

It is easy to verify that the stability condition in the space H 2 ^ of the 
two-layer scheme (29) 




(30) 
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is equivalent to the requirements 

(26*) B = B(t) > 0 for all t E lu t , 

(27*) 

which assure us of the validity of the estimate 

(28*) 11^+ilU < H^ilU > 

where 

||^n+l||^ = q II Vn+l + Vn 11^ + \\Vn+l ~ Vn\\ 2 R _^ A ■ 

In concluding this section, let us stress that condition (26*) is not only 
sufficient, but also necessary for the validity of estimate (28*), 

4. Stability with respect to the right-hand side. We now consider problem 
(lb) under conditions (9), (10) and (27), which are put together for later 
use. Since A and R are constant operators, identity (18) for (lb) is of the 
form 

(31) 2r(5t/o,t/o) + ||y(f + r)|| 2 = \\Y(t)\\ 2 + 2 t (<p, yo), t-nr. 

In the further development of a priori estimates of the form (20) or 
(21) a key role is played by the estimation of the functional 2 r(tp, y<> ). First 
of all, we give below the obvious inequality 

(32) 2 r (<p, t/o ) < T£ 0 \\y„ || 2 + |M| 2 , 

1 1 £ 0 

where e 0 = const > 0 is independent of r and h both. 


Theorem 2 Let A = A* > 0 and R = R* > 0 be positive operators. Then 
under the conditions B > sE, R > A/4, e = const > 0, a solution of 
problem (1) satisfies the a priori estimate 


(33) 


y(f + r)||<||Y(r)|| + 


V27 L 


r MOI 


1/2 


It suffices to estimate only a solution of problem (lb), since Theorem 
1 remains valid for B > eE. By merely setting in (32) e 0 — 2 e we deduce 
from (31) that 

(34) ll^(f + r)|| 2 <||y(f)|| 2 + ^||^)|| 2 . 

To finish the proof of the theorem, it remains to sum up this inequality with 
respect to the variable t = r, 2r, . . . , nr, exploit the fact that || Y{t) || = 0 
and apply Theorem 1. 

We cite here without proving the following assertion. 
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Theorem 3 Let the conditions of Theorem 1 be satisfied. Then scheme (1) 
is stable with respect to the right-hand side and for it the estimate holds 
for t > t: 

(35) ||y(t + r) || < ||y(r) || + M 2 max ( \\<p(t')\\ A -i + \\<Pi(t')\\ A -i) , 

where M 2 = const > 0 depends only on t 0 . 

Theorem 4 Let A = A* > 0 and R = R* > 0 be constant nonnegative 
operators and B = B(t) be a variable non-self-adjoint positive definite 
operator 


(36) B > eE, e = const >0, 

where a number e is independent of h and t, and let the condition 


(37) 


R > - A 
~ 4 


be satisfied. Then a solution of problem (lb) admits a priori estimate 


(38) 


\\y(t + T )\\ < 


2 \ft 




1/2 


Look at identity (31). It follows from (36) and (32) for e 0 = e that 

(39) r £ || y, || 2 + || Y(t + r) || 2 < || Y(t) || 2 + ~ || p(t) || 2 . 

With the relations || Y (r) || = 0 and || Y(t + r) || 2 > 0 in view, summing up 
over t = t, 2r, . . . , nr yields 


(40) 


£ r n^(0 ii 2 +11^ + t ) ii 2 < 7 T \\ R ( t ') 


or 


t 1 t 

(4i) Y. T \\y^)\\ 2 <- 2 Y. T \\^ , )\\ 2 - 

t'~T t' = T 

Further development of estimate (38) from (41) is based on the fol¬ 
lowing assertion of auxiliary character. 



Classes of stable three-layer schemes 


437 


Lemma 2 If y( 0) = y(r) = 0, then 


t 

(42) II y(t) II 2 + II y(t + t) || 2 < At J2 T II Vtit') II 2 

t' — T 


Indeed, 


(43) 


t 

y(t + t) + y{t) = 2 r y f (t'), 

t' — T 


t 

\\y{t + T) + y(t)\\ 2 <4 r|k-(0 l| 2 

t'=T 


In the notation w n = y n — y n _i we obtain 


w n+i = 2ry fn - i<J n , w 1 = 0, 
which implies the inequality 

II w n'+i II < 2r || y ln ' || + || w n ' || , n' = 1,2,. . . ,n. 
Summing up the preceding over n' from 1 to n we find that 

n 

Ikn+lll < 2 T H yt,n' II 

n'= 1 


or 


(44) 


t 

II y(t + t )~ y(t) II < 2 T \\yt( t> ) II» 

t' — T 

t 


II y(t + t) - y(t) || 2 < it T II y t {t') II 2 - 

t' ~T 


Putting inequalities (43) and (44) together with the. obvious identity 
(45) || y(t + r) + y(t) || 2 + || y(t + r)-y(t) || 2 = 2 (\\y(t) || 2 + || y(t + r) || 2 ) , 
we arrive at (42). Substituting estimate (42) into (41) yields (38). 
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Theorem 5 Let A = A* > 0, R = R* > 0 and B = B* > 0, A and R, be 
constant operators and R > ^A. Then for scheme (1) the estimate holds: 

1 n 

(46) ll^n+ill 2 < ||Yi|| 2 +g I] t-Mb-i ■ 

k = 1 

The fact that the operator B is self-adjoint is kept in mind in the 
estimation of the expression 

(47) 2r (<p,yt) < \\yi\\ B ■ IMI b -i < t e\\y^\\ 2 B + ~ \\<p\\ B - l , 

which is involved in identity (31). Putting e = 2 and substituting this 
estimate into (31), we obtain the inequality 

(48) ll>W 1 || 2 <ll^|| 2 + ~|k 1 ,|||- 1 , 

implying the desired estimate. Note that the operator B may depend on t: 
B = B(t). In that case we must write where B^ 1 = B~ l {t k ), 

5. Schemes with variable operators. If operators A and R depend on the 
variable t, the extra property of the Lipschitz continuity of A and R with 
respect to the variable t is needed in this connection: 

(49) | (( A(t) — A(t — t)) x,x) \ < t c 3 [A{t — r) x, x) 

for all x G H and t = 2r, . .. , (n 0 — l)r, where c 3 = const > 0 is independent 
of h and r; the condition imposed on the operator R is analogous. In this 
case the compound norm || Y(t+r) || = ||y(f + T - )!!^-) depends on the variable 
t\ 

(50) ||y(f + r)||^ = 1 (A(t) (y(t + r) + y(t)), y(t + r) + y(t)) 

+ t 2 (( R(t ) ~ \A(t)) y t (t),y t (t)j , 

(51) l|4' , (f)l| 2 j_ T) = \ (A(t - t) (y(t) + y(t - r)), y(t) + y(t - r)) 

+ t1 -t)~ \A(t- t)) y t -(t),y t -(t)J . 
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We modify the expression in the brackets oil the right-hand side of 
identity (18) by a simple observation that 

(■ A(y + i j),y+y) = (A(y + y),y+ y) + r (Af(y + y), y + y) , 

((R - i A) y { , yAj - ((R-\A) yt, + r ((.R - \ A) f y f , 

A = A(t-r), A f ={A- A)/r. 

Also, it will be convenient to introduce more compact notations 

(52) j = j { t + T) + \\Y(t + T)\\l t) , J = J(t) = \\Y(t)\\ 2 ^ Ty 
With these, identity (18) is recast as 

(53) 2 r (Bye , y°) + J = J + 2t (<p, y°) + t F , 

(54) F = l - ( At(y + y), y + y) + r 2 ((R - \ A )- t/ f , , 

showing the new members to be sensible ones. If the operators R — A/A. 
and A satisfy condition (49), then 

ll^ll < j (A(y + y),y+y) + r 2 c 3 [(R- \A) f y i ,y^ = c 3 J 

and from identity (53) for R > A/A it follows that 

(55) 2 r (Bye , t/o) + J < (1 + r c 3 ) J + 2r (<p, ye ) . 

In the general case when each of the operators R(t) and A(t) satisfies 
condition (49), we obtain 

(56) \\F\\<^-(A(y + y),y + y)+T 2 c. 3 (Ry t> y t )) + ^ (Ay^y?) 



under the constraint R > ^-A, where e = const > 0 is independent of h 
and r, since 

J > ~ (Ay t ~, Vi) for R > A . 
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Identity (53) yields 

(57) 2r (Byo , t/o ) + J(t + r) < (l + ^ r) J(t) + 2r (y>, yo ) . 

Having at our disposal the energy inequality (57), we can derive the a priori 
estimates in just the same way as was done for constant operators A and 
R. For example, for B > 0 inequality (57) for problem (la) implies the 
estimate 

(58) lin* + r)|| (t) <M 1 ||y(r)|| (r) if R>^A, 

where M i depends only on e, c 3 and t : . 

We bring together the basic facts in the following assertion. 

Theorem 6 Let variable operators A = A(t) — A*(t) > 0 and R = R(t) = 
R*(t) > 0 be Lipschitz continuous in t and let 

(59) R(t) > — A{t) for all 0 < t — nr < t 0 , 

where e = const > 0 is independent of r and h. Then for scheme (1) the 
following estimates hold: 

( 60 ) WYit + r^AM.WYir)^ 

+ M 2 r max [|WOII,- V) + IMOIL-i( t ')] 

for B(t) > 0, 0 < t — nr < t 0 , 

(61) \\Y(t + T)\l t) < M 1 \\Y(t)\\, ) +M 2 max ||v?(f , )|| 

V 2 V / T<t <.t 

for B(t) > IE, where s = const > 0, M i > 0 and M 2 > 0 are independent 
of t and h both. 

To avoid needless repetitions, we omit here the proof of the theorem. 

Remark Some requirements of Theorem 6 can be relaxed. For instance, 
the condition B > 0 can be replaced by the following one: 

(62) B > —c 4 r 2 A , 

where c 4 = const > 0 is independent of r and h both. Under condition 
(62) estimate (60) holds true for r < r 0 , r 0 = 1/(4 c 4 ). 
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6. Weighted schemes. In practice the reader frequently encountered the 
weighted schemes 


(63) 


yo + A y^ 1 ,<T2 - ) = <p(t) , r<t = nr<t 0 , 

1/(0) = y 0 , y{r) = y x , 


where y( a i’ a 2 ) = C r 1 y _)_ (1 — C r 1 — cr 2 )y + cr 2 y. The accepted view is that 
stability and accuracy of the scheme are governed by selection rules for real 
numbers <r 1 and a 2 . In Section 1 scheme (63) was written in the canonical 
form (1), making it possible to recover the operators 

(64) B = E + ria, - a 2 ) A , R = ^L±Zl A . 

Assumming that there exists an inverse operator A~ l and applying it, 
on the same grounds, to both sides of (1) with operators (64), we obtain 


B y a + t 2 Ry it + Ay - <p, t <t = nr <t 0 , 

(65) 

2/(0) = y 0 , y{r) ~ 2/i , 

where B = A~ 1 +(cr 1 —cr 2 ) r E , R = 1 ^ — -e, A — E, (p = A~ l tp, 

This implies that constant operators A and R are self-adjoint. 

On account of Theorem 1 with regard to (65) the operator inequalities 

hold: 

(66) R- ^A = ^ E> 0 for a 1 + a 2 > 0.5 , 

(67) B = A “ 1 + (<7j — a - ,) t E > 0 for cj 1 > a 2 and any A(t) > 0 . 
Theorem 7 If A(t) is a variable positive operator and the conditions 


(68) cr 1 > cr 2 , <t 1 + <r 2 > 0.5 

are fulfilled, then scheme (63) is stable and the estimate holds: 

t 

(69) ||^(* + r)|| < || Y(r) ||+ v / 2(cr 1 + <r 2 ) r||^(i , )||, 

t' — T 
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where 

(70) || Y(t + r) || 2 = \ || y(t + r) + y{t) || 2 + | (oq + o^-i) || y(t + r)-y(t) || 2 . 

Proof In what follows we distinguish two separate tasks. 

1) Stability with respect to the initial data. Since the conditions 
R > A/4 and B > 0 of Theorem 1 are fulfilled, we have for a solution of 
problem (65) with <p = 0 the estimate 

II Y(t + r) || <||y(OH, t'<t, 

and, in particular, 

(71) nn* + r)ii < ii no ii, 

where || Y(t + r) || is specified by formula (70) being a particular case of 
formula (24) with A = E and R = |(<7 1 + <t 2 )E incorporated . 

2) Stability with respect to the right-hand side. Consider problem 
(63) for ?/(0) = y(r) = 0 and seek its solution in the form 

n 

(72) y n+ i = E T9 n +i , t . y 0 = °> 

5—1 

where g n+ i s as a function of n for fixed s = 1,2,... , n satisfies equation 
(63) with <p = 0 for n > s + 1 and the initial data 

(73) g $+iiS + 2a 1 t Ag s + liS = 2<p s , g ss = 0. 

Substituting (72) into (63) and taking into account (78), we conclude 
that (72) is just the solution of problem (63). As we stated in (71), on the 
strength of stability with respect to the initial data we have for g n s 

(74) ]|G n+ i,J <||G s+ i, s || for fixed s = 1,2. 

where ||G n+ i, s ]| is expressed through g n and g n+1 by relation (70). We 
find from (73) that g s+i s = 2 (E + 2a 1 rA)~ l (p and establish the relations 
|| E + 2<t 1 tj 4)~ 1 || < 1 and || g s + l s || < 2|| <p s ||. This is due to the fact that 
E + 2CTJT-A > E for cr 1 > 0 

By assumption, g s s = 0. This provides support for the view that 
|| G s+ i iS || 2 = 1 1 | g s+ i, s || 2 + 2 (^i + <J 2 ~ 2) II 9 s+i, s l | 2 
= ^ (o-i + C>) II 9 S + i, s IP < 2 (oq + <t 2 ) || <p s || 2 , 



Classes of stable three-layer schemes 


443 


giving 

(75) || G n+ i, s || < || G s+ i, s || < \/2(o-i + o- 2 ) II V, II • 

Substituting (75) into the right-hand side of the inequality 

n 

II Yn+L || < J2 T II Gn + i,s || 

s = l 

we obtain for a solution of problem (63) with y( 0) — y(r) ~ 0 the estimate 

t 

(76) II Y(t + 7") || < v / 2(<Ti+ct 2 ) t MO II. 

t' — r 

which in combination with (71) implies (69). 

Theorem 8 If A(t) = A*(t) > 0 is a positive operator and conditions (68) 
are satisfied, then for a solution of problem (63) the inequality 

1 r * 1 1/2 

(77) || Y(t + r) || < || Y(r) || + — ^ r 

holds, where || Y(t + r) || is given by relation (70). 

To prove this assertion the estimates 

2 r(<p,yo) =2T(A~ 1 <p,yo) < 2r||t/= ■ \\<p\\ A -i 

< 2 T \\y° ||^-i + g IIyIU-i , 

2r (St/o ,t/o) > 2 T (A- 1 yo,yo) = 2r||t/o|| 2 _ 1 

are incorporated in identity (18) for scheme (65). 

Applying Theorem 3 to scheme (65) with a constant positive operator 
A, it is plain to derive under conditions (68) the estimate 

(78) || Y{t + r) || < || Y(r) || + +M 2 max (|| A~ l p{t') || + 10“ Vf(OII) • 

T<t < t 

Note that estimate (60) holds true for scheme (63) if A(t) = A*(t) > 0, 
A(t) being Lipschitz continuous in t, and 



1 

r MII ’ 
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while the estimate of the form (61) is valid for 


Vi > <*2 - 


1 — £ 
w 


0 < £ < 1 . 


7. Examples. It seems worthwhile giving several schemes of particular 
forms. 

1) Scheme (1) with the operators R = xE and B = E 


(79) y { + xr 2 y n + Ay = ip 
is stable for xE > .A/4, that is, for 

(80) x > | || A ||. 

A particular case of scheme (79) is the Du Fort-Frankel scheme known 
as the “rhombus” scheme for the heat conduction equation 


du d 2 u 
dt dx 2 


0 < a: < 1 , < > 0 , u(x ,§) — u 0 {x) , 

u(0, t) = u(l, t) — 0 , 


emerging from the explicit unstable scheme 

y{x + h,t) — 2 y(x, t) + y{x — h, t) 


yi+Ay = 0, Ay = -y s 


h 2 


upon replacing y(x, t) = yj by the half-sum \(y’ i +l + yj *) = \ (y { + y { ). 
The outcome of this is 


(81) 


ik - Vi _ Vi +1 - (.Vi + Vi) + V-. 


i— 1 


2 r h 2 

Also, it will be sensible to write (81) in canonical form. Since 
y + ij = 2y+ r 2 y u , 


T 

the right-hand side of (81) equals y Sx — Therefore, 

r 2 M . M 4 2 ir h 4 

yt + j^ytt + A y = 0 ’ A y = -y ^ > II A II = ^ cos ~y < 
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Comparison of this equation with (79) gives x = l/h 2 > 11 ^4 11/4, that 
is, the Du Fort-Frankel scheme is stable for any r and h. This is a way 
of producing an analog of this scheme for the case when L is any elliptic 
operator with x still subject to condition (80). 

2) The asymmetric three-layer scheme 

3 1 3y — 4y + y 

O Vt - o Vt + A y = V or -o- Y Ay = f 

2 2 2 T 

suits us perfectly for solving the heat conduction equation. Using the for¬ 
mulae 

9 

r r r 

y t = y° + 2 Vit . Vt = y°- 2 l Jit ’ y = y + T y° t + Y Vit - 

it is plain to reduce it to the canonical form 

/ E 1 \ 

(E + t A) ijo + t 2 y — + -AJ ijit + Ay = f , 

giving B = E + tA and R = E/t + | A. These assure us of the validity of 
the conditions 


1 + e 

R > —— A , 0 <£ < 1, B > E 

~ 4 ~ ~ 

for any ^4>0. If A = A* > 0, the scheme concerned is stable in the norm 

iin* + = hii^ + t)\\\ + umi) + r \\ yt \? A . 

8. Three-layer schemes with non-self-adjoint operators. The three-layer 
explicit scheme with a self-adjoint operator A 

yo + A y = 0 , J 4 = J 4*>0, 

is absolutely unstable; the necessary stability condition R > |A is violated 
for this case, since R = 0. This scheme is unstable in any norm || • and 
refers to a generalization of the well-known Richardson scheme for the heat 
conduction equation 


Vi - Vi Vi -1 ~ 2y i + Vi+i 
2 r h' 2 


The implicit scheme By° + Ay = 0 with any operator £? = £?*> 0 is also 
absolutely unstable. 
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We now consider the scheme with a skew-symmetric operator A: 

(82) yo+Ay = 0, A = -A* . 

We are going to show that this scheme is stable for r|| A|| < 1 and for it 
the energy identity holds true: 


<^?i.+i — 4 ? 

where 4+i = \\y n+1 || 2 + 2 r( y n+l , Ay n ) + || y n || 2 > 0. 

All the tricks and turns remain unchanged: first, write the difference 
equation in the form 

y + t Ay = ij - t Ay 

and compute the squared norms on the left and right-hand sides 

II2/II 2 + 2r(y, Ay) + r 2 || Ayf = || ij\\ 2 -2 r(Ay,y) + r 2 || Ay\\ 2 , 

then add ||t/|| 2 to both sides and take into account that A is a skew- 
symmetric operator, that is, (Ay, y) = —(y, Ay). As a final result we obtain 
4+i — £ n — . . . = £ l . What is more, we claim that 4+i > 0. Indeed, 

4+1 > II Vn + l II 2 ^ 2 T II Vn+l II • II A Vn II + II Vn IP 
>|| ? y n || 2 -r 2 ||Ai/ n || 2 >0 

under the restriction r|| A|| > 1. Here H is a real space. In the case of a 
complex space H we have the quantity 

4+i = WVn+i II 2 + 2rRe (y n+l ,Ay n ) + \\y n || 2 , 

with respect to which both the above reasoning and results are still valid. 
Example Of special interest is the Schrodinger equation 


du d 2 u 

1 ~rr = — q u , q = const > 0 , 0 < x < 1 , 

at ox 2 

u(0, t) — u(\, t) = 0 , u(x, 0) = u 0 (x) . 

We introduce, as usual, on the segment 0 < x < la uniform grid 
ui h = {xq = ih , i = 0,1,... , N ; h N = 1} . 
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Let H = Q,h be the space of all complex functions defined on the grid 
Cu h and vanishing at the points x = 0 and x — 1. Also, it will be sensible 
to introduce 

N -1 

(y, v) = E Vk v k h , 

k~ 1 

where v k is the complex conjugate function of v k . The next step is to write 
the initial equation in the form 


. <9 2 


and introduce in the space H the operator 


Ay = i y Sx - i q u . 

The operator A is skew-symmetric: (Ay,v) = —(y,Av), since 


N -1 


N -1 


(Ay, v) = J2 (* Vsx,k) v k h +J2 H y h 


k=i 


k =i 


N-l N-1 

= - y k (*' v £x,k) h ~J2 y k H 3 v) k h = ~(y, Av) 

k~l k =1 

The norm of the operator A admits the estimate 

Mil < £f + ?- 

The explicit scheme (82) for the Schrodinger equation takes the form 

0 

. y° + *Vsx ~ i 3 y = 0 > y & Ah ■ 

It is stable for r|| A || < 1, that is, under the constraints 

/ 4 \ h 2 

7T + 3 r<1 or T < ~a -Tc ■ 

\h 2 1 i + qh 2 

As the second possible example we look at the scheme 

yo+y°=0 
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associated with the transfer equation 


du 

dt 


du 

dx 


= 0 , 


which is stable for r/h < 1. 

Observe that the explicit three-layer scheme 


Vtt+Ay = 0 

with a skew-symmetric operator A = —A* is absolutely unstable, while 
the scheme with a self-adjoint operator A = A* > 0, as stated before, is 
conditionally stable for 

r 2 2 

E > — A or r < — ,.. 

4 vPl 

(for Ay = —y Sx we obtain r < h). 

9. Other a priori estimates. Together with scheme (1) the reader may be 
confronted with schemes written in the form 


(83) (E + t 2 R)y it +B yo + Ay = if , y(0) = y 0 , y(r) = y 1 . 


Such schemes formally can be obtained from (1) by replacing R by R = R + 
E/t 2 . With this substitution in mind, one can easily conclude that scheme 
(83) is stable for if > A/A and write down the appropriate estimates. 

Compound norms || Y || arise naturally in connection with the energy 
balance equation. Their structure seems to be rather complicated. It is 
desirable to possess a priori estimates for solutions of problems (1) and 
(83) in the usual energy norms of the spaces Ha and Hr. We proceed to 
the derivation of such estimates. This amounts to setting any three-layer 
scheme in the form 


(84) 


D y.it + B y° + A v = <p{t) , o < t e w r , 
y(o) = y 0 , y t (o) = y 0 , 


where D = D(t), A = Ait) and B = B{t) are linear operators. In particu¬ 
lar, D = t 2 R for scheme (1) and D = E + t 2 R for scheme (83). 

Together with (84) we consider the problems 

(84a) Dy {t + Byo+Ay = 0, t/(0) = y 0 , t/ t (0) = y 0 , 

(84b) Dy it + B yo + Ay = f(t), t/(0) = y t (0) = 0 , 
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assuming that 

(85) A{t) = A*(t) > 0, D(t) = D*(t) > 0, B{t) > 0 , 

(86) A(t) and D{t) are Lipschitz continuous in t with constant c 3 . 

Theorem 6 implies that scheme (84) under conditions (85)—(86) and the 
extra restriction 

(87) D > ^ t 2 A , 

where a number e > 0 is independent of r and h, is stable with respect to 
the initial data and a solution of problem (84a) admits the estimate 

(88) ||y n +i|| (n) < Mi 11^11^, 

where My = My(c 3 ,£,t 0 ) > 0 is independent of r, h, n and 

(89) ll^ n + 1 ll( IJ ) = 4 + y n+ilL(i n ) 

2 

+ A(t n )J y i n , y t1 ^j , 

(90 IIUIlf^ilk + ftllT, 

+ (( d ( t ) - j- a ( t )) y t (o),yt(o)) ■ 

The constant M\ equals 1 if the operators A and D are independent of t. 

In order to turn from (88) to the estimates in the spaces Ha and Hjj, 
we shall need yet some bilateral estimates of the functional || Y n +i ||. 

Lemma 3 Under conditions (85) and (87) one has 
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Proof To make our exposition more transparent, it is convenient to deal 
with 

J = \\\y + y\\ 2 A + {{ D -^ A ) yt>vt) ■ 

To prove inequality (91), we concentrate mainly on 
J = \ (WvWa + ‘2(Ay,y) + ||y|D 

- | ( \\yf A ~ 2 (Ay, y) + \\y\\ 2 A ) + (Dy t ,y t ) 

= (Ay,y) + \\y t \\ 2 D 

with respect to a new variable y = y + ry t . With this relation established, 
we arrive at 

J = \\y\? A +T{Ay >yt ) + \\y t f D < \\y\\\ + r\\y\\ A ■ || y t || A + \\y t f D . 
Condition (87) yields the estimate 


I Vt IL < 


t\J 1 + £ 


D > 


so that 

J <\\y\\ 2 A + -^= £ \\y\\A • IklL + lklL < (IML + lklL) 2 - 

This implies the first inequality of the lemma. 

A simple observation that J = (Ay t y)+\\y t \\ 2 D justifies the forthcoming 
substitution y = y — ry t , leaving us with 

J ~ (Ay,y) ~r(Ay,y t ) + \\y t \\ 2 D . 

Making use of the generalized Cauchy-Bunyakovskii inequality 

( A y,y t ) < II IU ' II Vt IL 

and taking into account (87), we obtain 

J>\\y\? A -r\\y\\ A ■ IkIL +\\yt\\ 2 n 
> \\y\\ 2 A --^= Ny!U ■ \\yt\\ D + \\yt\\ 2 D ■ 
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Applying now the inequality ab < Sa 2 + 6 2 /(4<5) yields 

(94) J>(i_ i )|| !i ||3 + ( 1 __L_)|| !(1 ||J ) . 

Assuming the second coefficient to vanish, we deduce that 6 = 1/(1 + e) 
and 

J>^T £ \\y\\ 2 A - 

The second estimate of the lemma is proved. 

In order to obtain the third estimate, we require the equality of the 
coefficients at the members ||i/|| 2 and ||t//] 2 in (94); this yields 


1 - 6 = 


/ T+7- 1 


1 + £ + 


Since \/T+~e < 1 + e for any e > 0, it follows from the foregoing that 

1 - 6 > jifei and 

j > j(TTu (lls'C + lli'.lll) > jpifC) (lli-L + lb.igc 

Thus, the lemma is completely proved. 

Upon substituting (91)—(93) into (88) we obtain estimates for problem 

(84a) 


(95) \\y n +i IL(i n ) - Mi 

(96) WVn + l IL(i n ) + lly<lln(t n ) ■ 

In order to prove the stability of scheme (84) with respect to the right- 
hand side, let us employ the superposition principle and seek a solution of 
problem (84b) as a sum 

(97) y n =H T 9„, s , n= 1,2,..., J/o — 0 , s = l,2,..., 

5 — 1 

where g n s as a function of n for any fixed s satisfies equation (84a) and 
the initial conditions 

(0.5 rB(t s ) + D(t s )) =IP " g s s = o. 
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Since D > 0 and the space H is finite-dimensional, D > SE and the 
inverse operator D~ l exists (6 > 0). As far as B > 0 and D = D* > SE, 
we have for a solution of the equation (0.5 tB + D) u) = <p the estimate 

IHId < so that 

ll(fi'i)s,JI_D(( s ) < II^sIId" 1 ^) ■ 

By virtue of estimate (95) we are led to 

llfln + l,«llA(t n ) — Ml \j £ ll(fl l t)s,«llz)(t s ) 

i±i ii v ,ii b _. (i<) . 

Making use of (97) and the triangle inequality, we derive the estimate for 
a solution of problem (84b) 

(98) lk+ill A(in) < Mi 

’ 5 = 1 

We summarize all the results obtained in the following assertion. 

Theorem 9 Let conditions (85)—(87) he satisfied. Then scheme (84) is 
stable with respect to the initial data and right-hand side and a solution of 
problem (84) satisfies the a priori estimate 

(99) \\y n +i IL(i„) 

- Ml \l^T ( + lk(°)L(r) + J2 r ll^llc- 1 (l5)) ■ 

V V 5=1 ' 

Corollary If D = E + t 2 R > E and D~ l = E, then \\ip a H^-i < || || and 

for a solution of problem (84b) the following estimate is valid: 

( 10 °) Ik+ilL^) < Mi \j 1 -^ J2 r IHI- 

* 5=1 

Finer estimates that are similar to estimates established for the string 
vibration equation (for more detail see Chapter 5) hold true in a more 
narrower class of schemes 


(101) Dy tt + Ay = , 0 < t = nr < t 0 , y(0) = y 0 , y t (0) = y 0 . 
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In order to understand the nature of this a little better, we take for 
granted that 

A and D are constant operators, 

A and D are self-adjoint positive operators. 

Then under condition (87) for any scheme of the form (101) estimate (99) 
is valid with Mi = 1. By merely setting x = D l ! 2 y and C = D~ l l 2 AD~ l l 2 
we reduce (101) to the form 

(103) Xf t + C x = (p , k(0) = x 0 , 2! ; (0) = x 0 . 

Applying the inverse operator C -1 to scheme (103) yields 

(104) C~ l xi t T x = C~ x (p , k(0) = x 0 , *((0) = x 0 . 

Comparison with scheme (84) reveals the correspondences 

C~ l ~ D , E~ a , C~ 1 <p~<p. 

With this in mind, condition (87) acquires the form 

C- 1 > i±£ t 2 E or E > ^ r 2 C. 

~ 4 ~ £ 

Involving estimate (99) with M\ = 1 and taking into account that C 
is a constant operator, we arrive at 

(105) IK+ill < \j^ 1 f IH°)II + II^WIIc- 1 +X1 t W C ~ 1( p\\c) 

' 5 — 1 ' 

with x = D x ! 2 y and (p = D~ l ! 2 p incorporated. What has been done is to 
derive the desirable expressions 

|h(0)||;Li = {C~ l x t { 0),x t (0)) 

- (D ll2 A- l D ll2 D ll2 y t {Q),D ll2 y t { 0)) 

= 11 ^( 0 ) 111 - , 

- ( D l/2 A- l D 1/2 D~ l f 2 ip,D~ l f 2 ip) 

= {A~ l p,p) = \\pW\-, , 

so there is some reason to be concerned about estimate (105) in the original 
variables: 

(!06) \\y n +i\\ D < (lll/(°)llc + 11^(0)11.4- +X1 ■ 

' 5 — 1 ' 

Thus, we have proved the useful assertion. 
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Theorem 10 If conditions (87) and (102) are satisfied, then for scheme 
(101) a priori estimate (106) takes place. In particular, for scheme (101) 
with D = E and y 0 = y 0 = 0 we have 


\\y n +i\\ < 


1 + £ 
£ 


Y, r lk.|| A -i 

3 = 1 


(see Chapter 5, Section 6.2). 

As an example consider the weighted scheme 

yp + A(ay + (1 — 2 a) y + cry) = ip, A* = A> 8 E, 8 > 0 . 

Substituting y + CT 2 yp for ay + (1 — 2cr)y + ay we obtain 

(107) (E + ar 2 A)y n + Ay- ip, 

yielding D = E + ar 2 A. The stability condition D > ^p-r 2 A or E > 
((1 + 0/4 — a) t 2 A is ensured by 

^ 1 + £ 1 

For the explicit scheme with a = 0 this implies that 

2 

0(i + 0II A II 

Having stipulated this condition, the explicit scheme (j/ t - t = y Sx ) for 
the string vibration equation is stable for r/h < l/y/(l + e) (see Chapter 
5, Section 6). 

10. On regularization of difference schemes. Stability theory of difference 
schemes outlined in this chapter may be useful for the statement of a general 
principle (the regularization principle) providing with schemes of a desired 
quality, that is, stable, generating an approximation and satisfying the extra 
economy requirement of minimizing the arithmetic operations necessary in 
computer implementations of resulting difference equations. 

The economy requirement in the case of nonstationary problems in 
mathematical physics generally means that the number of arithmetic op¬ 
erations needed in connection with solving difference equations in passing 
from one layer to another is proportional to the total number of grid nodes. 
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In studying the canonical form of two-layer and three-layer schemes 

(108) (E + r R)y t + Ay = p, y(0)=y Ot B = E + r R, 

(109) By° +T 2 Ryt t +Ay = <p t y(0) = y Ol y{r) = y 1} 

it has been disclosed that the operator R (regularizator) is responsible 
for stability. 

Sufficient stability conditions have now simplified forms 


( 110 ) 


R>^ A . ^=)-hT4| 


for two-layer schemes, 


R > - A or R > ——— A for three-layer schemes. 
4 - 4 


Stability or instability of a scheme from the primary family depends 
only on selection rules for the operator R. From the point of view of stability 
theory the arbitrariness in the choice of the operator R is restricted by the 
following requirements: 

• a scheme should belong to the primary family, that is, B = E + tR 
for (108) and R = R* > 0 for (109); 

• conditions (110) should be valid. 

To obtain a stable scheme of a desired quality, one is to construct 
a scheme generating an approximation of the attainable order and being 
economical, that is, it is required to solve the equations (E + rR)y = F for 
(108) or ( B + 2TK)y = F for (109) in a minimal number of operations (in 
a certain sense). 

First of all observe that if scheme (108) or (109) with an operator R 
is stable, then so is a scheme with an operator R > R. Common practice 
in designing difference schemes involves the development of a scheme which 
generates an approximation of the attainable order and is economical. With 
the indicated properties, its stability will be given special investigation. 

The main idea behind regularization of difference schemes is that the 
schemes of a desired quality should be sought in the class of stable schemes 
starting from an original scheme and replacing it, by changing the operator 
R , by another scheme of a desired quality belonging to the class of stable 
schemes. 

Many modes of constructing schemes of a particular form can be 
treated as simplest regularization modes. The canonical form of a scheme 
is convenient not only for practical tests of stability, but also for proper 
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evaluation of the order of approximation. The factor at the member R in 
(108) is t, while in (109) is r 2 . Therefore, if in the case of two-layer schemes 
the condition || Ru t || = 0(1) with such a variety of R continues to hold (u 
is a solution of the initial differential equation), then the approximation er¬ 
ror changes by a quantity O(r) when R changes. In the case of three-layer 
schemes the condition || Ru.£ t || = 0(1) ensures that the regularization leads 
to schemes with the approximation error differing by a quantity 0(r 2 ). For 
this reason three-layer schemes are good enough for the purposes of the 
present chapter in designing stable schemes of second-order approximation 
in r. 

The main problem here is connected with selecting the regularizator 
R. Since regularity conditions became operator inequalities, it seems rea¬ 
sonable to choose as R operators of the most simplest structures which are 
energetically equivalent to the operator A. Let, for instance, A and A$ be 
energetically equivalent operators with constants j 1 and y 2 , so that 

(111) 7iA 0 <A<y 2 A 0 , 7 i > 0, 7 2 >0- 

Keeping then R = aAo we have at our disposal stable schemes: for a > c 0 7 2 
(or a > 7;y 2 ) in the case (108) and for a > 7 2 /4 in the case (109). 

A simplest form of R is the operator R — aE (Aq — E). Stability 
conditions are satisfied if a > c 0 || A || for scheme (108) and a > ||| A || for 
scheme (109). 

Example 1 The explicit three-layer Du Fort-Frankel scheme for the heat 
conduction equation from Section 3.7 belongs to the family 

(112) yo + a r 2 y lt + Ay = 0 , ^ > 4 11 ^ 11 . A ~ A* > Q . 

Indeed, 

2 a a ||,m 4 2 7r/i 4 1 

Ay=-Ay, Ay = y Sx , || A || = — cos — < , ^=^ 7 , 

that is, the condition a > |||A|| is satisfied. This scheme provides a 
conditional approximation of 0(h 2 ) for r = 0(h 2 ). 

It is not difficult to write down an explicit stable scheme for the heat 
conduction equation with variable coefficients 


du 

dt 



0 < Cj < k(x, t) < c 2 , 


<> 0 , 0 < £ < 1 , 


ii(0, t ) = u{\, t) — 0 , u(x, 0) = u 0 (x). 


( 113 ) 
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In this case we agree to consider in (112) a = c 2 /h 2 , Ay = —Ay and 
A V = ( a Vg)x■)■ 

For the multiple heat conduction equation 

(114) z = u„..., lp )ec, 

CV — 1 a 

U ] p = 0 , u(x,0) = U 0 (x) , 

G being a parallelepiped (0 < x a < l a , a = 1,2, . . . ,p), 0 < c l < k a < c 2 , 
other ideas are connected with 

v i v 

cv=l a cv = l 

where h a is the step of a grid ui h = {k = (x 1 , . .. , x p ) G (5} along the 
direction x a . 

Let Aq — Ai + A'j, where Ai and A 2 are adjoint or “triangular” (with 
a triangular matrix) operators, so that 

( A oy, y) = 2 {A x y, y) - 2 (A 2 y, y). 

Setting R = aA\ or R = aA 2 we arrive at scheme (108), which is stable for 
a > 27 2 2 (t 0 ( 7 2 is a constant involved in (111)). 

Example 2 The asymmetric scheme for the heat conduction equation 

du d 2 u 
dt dx 2 

belongs to the family of “triangle” schemes having the form 

(7 T 

(H5) y t + — y st = Ay, Ay = y Sx . 

Here 

a 

Ay = -Ay , Ry- -y- , A 0 = A , y 1 = y 2 = 1 . 

Scheme (115) is stable for a > 1 — A- anc [ conditionally approximates the 
heat conduction equation to 0(h) as r = 0(h 2 ). 
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For equation (113) we accept 


and take 


7 2 = c 2 , Ay= -( ay s ) , Rij = -y s 


/ ft \ 

- C2 ^ 1- 


With regard to problem (114) we thus have 


■A 1 ^ 1 

R y = a it y * a or Ry = ~ a t y *a ■ ^ t > 


«=1 A ° 


<7 > C~ 1 — 


a — I. 


2tAJ ’ 


1 


A=fs s i,, 

a= 1 « 


It is important to note that while constructing the Du Fort-Frankel 
scheme as an original scheme the explicit unstable scheme t/o = Ay generat¬ 
ing an approximation of 0(r 2 + h 2 ) has been taken with further modification 
corresponding to the regularizator of the simplest type (if = -pjE, c = 
in (112)). 

Afterwards when the sweep formulae became customary, one began 
to analyze in full details two-layer implicit schemes (weighted schemes) for 
which if = a A. These schemes obviously represent a particular case of the 
scheme with if = a A 0 . 

We point out one more selection rule for if. Let A$ — Ai + A 2 , 
A 2 = A* >0. Choose if in such a way that the two-layer scheme possesses 
the factorized operator 

B — (E -\- a r A\) (E -\- a r A-i) — E + r (c A$ + c 2 r A\ A 2 ), 


so that 

if = a Ao + j 2 t A 1 An . 

Since (A l A 2 y,y) = (A 21 /, A 21 /) = ||A 2 y|| 2 > 0, this scheme is stable if 
^ > 7 2 <V 

Various schemes with the factorized operator 

B — (if + co ifi) (if + co if 2 ) , if 2 = if 1 , 

are in common usage as iteration schemes for solving equations of the form 
Ay - <p. 
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Homogeneous Difference Schemes 
for Time-Dependent Equations 
of Mathematical Physics 
with Variable Coefficients 


7.1 HOMOGENEOUS DIFFERENCE SCHEMES FOR THE HEAT 
CONDUCTION EQUATION WITH VARIABLE COEFFICIENTS 

In the present chapter the objects of investigation are various homogeneous 
difference schemes for the heat conduction equation and a second-order 
equation of hyperbolic type with variable coefficients in several settings: 
on nonequidistant grids, with the boundary conditions of the third kind, 
etc. The results obtained in the preceding chapters find a wide range of 
applications in designing homogeneous difference schemes and establishing 
their stability. Especial attention here is being paid to one-dimensional 
problems. 

1. The original problem. We begin by placing the first boundary-value 
problem for for the heat conduction equation in which it. is required to find 
a continuous in the rectangle Dt = {0<1'<1, 0 < < < T} solution to the 
equation 

, du , . » d r, , . 8u\ 

(!) w = Lu + f(x,t), Lu = — \ k{x,t) —) , 

satisfying the initial condition 

(2) u(x, 0) = u 0 (x) , 0 < x < 1 , 
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and the boundary conditions 

(3) u(0, t) = u 1 (t) , u(l, t) — u 2 (t) , 0 <t<T, 

under the assumptions that the coefficient k(x,t) is bounded from below 
and from above: 

(4) 0 < Cj < k(x,t) < r 2 , (x,t) E Dt , 

where c L and c 2 are constants. 

Also, we take for granted that problem (l)-(3) possesses a unique 
solution with all necessary derivatives. 

2. Homogeneous difference schemes with weights. In a common setting it 
seems natural to expect that a difference scheme capable of describing this 
or that nonstationary process would be suitable for the relevant stationary 
process, that is, for du/dt e 0 we should have at our disposal a difference 
scheme from a family of homogeneous conservative schemes, whose use 
permits us to solve the equation Lu + f = 0. 

One way of covering this for the heat conduction equation is to con¬ 
struct a homogeneous conservative scheme by means of the integro-interpo- 
lation method. To make our exposition more transparent, we may assume 
that the coefficient of heat conductivity k = k(x) is independent of t. The 
general case k = k(x,t) will appear on this basis in Section 8 without any 
difficulties. 

We proceed as usual. This amounts to introducing the following grids: 
an equidistant grid on the segment 0 < x < 1 with step h 

= { x z = ih , * = 0,1,... , N , h=l/N}\ 

a. grid on the segment 0 < t <T with step r 

u T = {tj = jr , j = 0, 1,.. . , N 0 , t = T/N 0 }; 

a grid in the rectangle Dt 

& h t ^ h ^ ^ r J ^ i 

and to forming 

ui hT = Lo h x lo t = {{x^tj) , x t = ih, , 0 < * < N , tj = jr , 0 < i < N 0 } . 
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The starting point is the balance equation written in the rectangle 
{ x i -\/2 < x < tj < t < tj .|-i with regard to the governing equation 

| = i»+ /(«,<), *“=+*(+ + . 

The outcome of this is 

*2 + 0.5 ( j + l 

(5) j [u(x,t j + l )-u(x,t j )]dx = j [w(x i+1/2 ,t)-w(x i _ l/2 ,t)]dt 

*i-0.5 t j 

t j +1 *2+0.5 

+ I dt / f(,r,l)dx, w(x,t) = k ^ , 

‘- 0 - 0.5 


where the integrals and derivatives are yet to be replaced by 


i + 0.5 


u{x ) t) dx ~ hu(x i) t) . 




1/2 



- 1 / 2 . 0 * 


/(+, 0 




- 1/2 : 


h t 


'Pi 


where ss designates approximation, a is a numerical parameter and the 
coefficients a, : are expressed through the values of k{x) for x i _ 1 < x < x i 
by means of pattern functionals yf[&(s)], — 1 < s < 1, so that 


a(xi) = a t 


A k(x^ -f- sh'j 


or 



1 

k(x i + sh ) 


Here +£+)] i s linear nondecreasing functional, for which the conditions 
+1] = 1 and +s] = —0.5 hold. 
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From such reasoning it seems clear that the operator 


T 9 (b 9u 

Lu- — [k -g— 

ox \ ox 


is approximated to .second order by the difference operator A u — ( au g ) x , 
meaning 

A u-Lu = 0(h 2 ) if k(x)eC ,( - 3) . 

In so doing 0 < Cj < a(x) < c 2 . 

Upon substituting the resulting expressions into (5) and replacing u 
by y we obtain the difference scheme for the grid function y(x i ,tj): 


(6) -—-—— = A (ay 3 ^ 1 + (1 - cr) y \) + ^ , 

i = 1,2,... ,N- 1, i > 0 , 

where Ay = ( ay g ) x . 

The simplest formulas 

a i- k i-i/2> a t = 0.5 (k_ { + k t ), 

v\ = fi +l '\ = o.5 (// +fi +i/2 ) 

suit us perfectly for determination of ip\ and a,-. 

When the difference equation (6) is put together with the s-upplemen- 
tary conditions?/ 0 = u 0 (x\), y : Q = ,= y, 2 {tj), there arises naturally 
the difference boundary-value problem 


( 7 ) y t = A(cry + (l-cr)y) +tp, xEio h , t - jr > 0 , 

y(x, 0 ) = u 0 (x) , xECd h , 

y(o,t) = ki(t), y(M) = /u(0 - feuy, 

Ay = (ay g ) x , 0 < c 1 < a < c 2 , 

within the usual notations 

y = vl =y(xi,tj), y = yj +1 = yKUi+i) ■ 
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The next step is to reduce the resulting scheme to more convenient 
forms in trying to avoid cumbersome calculations. The case (7 = 0, relating 
to the explicit scheme, is simple to follow: 

vi +1 = v{ + T + v : i) 


= (1 r(a,.+a,. + I H 


+ Y2 M- 1 +T:+i^ +1 ) . 

permitting us to find a solution on every new layer. 

The case <7^0, relating to the implicit scheme, is connected with the 
equation related to the unknown y = y 3 + l ’ 


ctt Ay — y = —F , F~y + r(l~~ a) Ay + rip, 
which can be written in the augmented form 
(8) A i y i _ 1 - CiVi + A i+l y i+l = -Fi , i = 1, 2, ... , N - 1, 
Ai — a t a,/h“ , C'i = At + ^4*_|_r + 1 , 


Fi = (i - ^2 (! - a )( a i + T+i ))vi 

+ (! - <?) { a iV,-i + a i+iUi+i) +ripi 

with the supplementary boundary conditions for i = 0 and i = N 
Vo ~ Ci i^j + i ) > Vn = ) • 

The difference boundary-value problem associated with the difference equa¬ 
tion (7) of second order can be solved by the standard elimination method, 
whose computational algorithm is stable, since the conditions A{ ^ 0, 
|C'i| > \Aj\ + |4i +1 | are certainly true for a > 0. 

The recurrence formula, 

F ! = -y{ - -—- F i~ l + T Fi 

a a 

is aimed at finding the right-hand side Fi = F- of equation (8) with a 
smaller volume of computations. 
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The following implicit schemes are frequently encountered in the the¬ 
ory and practice: 

a) the symmetric scheme (a = 0.5) 

Vt = 0-5 A (y + y) + ip ; 

b) the forward scheme or purely implicit scheme (a = 1) 

Vt = A y + p ■ 

3. Stability and convergence. The general stability theory for two-layer 
schemes applies equally well to the stability analysis of the weighted scheme 
(7). With this aim, the appropriate difference scheme with the homoge¬ 
neous boundary conditions comes first: 


(9) y t = A (cry + (1 - a) y) + <p, x£u> h , t> 0, 

y(x, 0) = u 0 (x) , y — 0 for x = 0 , x = 1 . 

All the tricks and turns remain unchanged: we, first, introduce the 
0 

space of all grid functions given on the grid Ca h and vanishing on the 

0 

boundary for x — 0 and x — 1 and then define in that space H = an 
inner product 

N- 1 

(y, v) = E ik v i h 

i -1 

and associated norm ||t/|| = \J (y, y). By means of a linear operator A 
acting in accordance with the rule 

A y = -A y = -{a y s .), c for y £ H 

the preceding scheme (9) can be rewritten as 

(10) y t + A (ay + (1 - a) y) = , t = jr > 0 , y(0) = u 0 . 

Observe the operator A so defined is self-adjoint and positive definite: 

A*=A>0, 6 E < A < A E, 6> 0, 

8 = min k,.(A), A = ||A||= max Aj.(A) 


where 
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and Aj,(d4) is the Arth eigenvalue of the operator A. It follows from Green’s 
formula 

(Ay,y) = ~{{ay s ) x ,y) = (a, (y s ) 2 ] 

that 

0 0 

c 1 A < A < c 2 A , 

0 

where Ay = —y^x f° r V G H, with further reference to the relation 

{Ay, y) - {{Vxf, l] • 


0 


The smallest and greatest eigenvalues of the. operator A are given by the 
formulas 


b 


4 

h? 



4 r, 7T h 

/G co8_ X 


0 0 

thereby justifying the estimates 6 > c 1 S and A > c 2 A . 

We know from the general stability theory that scheme (10) is stable 
in the space Ha with respect to the initial data, that is, 


\\y 3 \\ A < lli/°ll A if ^=° 


under the constraint 


In the case where 


a > ( 7 , 


1 1 
2 r A 


1 1 — £ 

a > ay , = --— , 0 < £ < 1 , 

2 r A 


a solution of problem (10) satisfies the estimate 



For the explicit scheme ((7 = 0) we might have 


( 12 ) y\ +l = (i “ + a i+S)y'{ + (nyi-i + H+iy 3 ) + rtp 3 


where the coefficient at the member yj is non-negative, provided the con¬ 
dition 

2 r 



466 Homogeneous Difference Schemes for Time-Dependent Equations 


holds. Under this condition the relation 

ll^ + 1 |lc <IHIc + ll^llc 

takes place. Summing up the preceding other j = 0,1,2,... , we obtain the 
inequality 


(13) 


||^' + 1 



C ’ 


which expresses the stability of scheme (10) in the space C if 


(14) 


h 2 


r 



This condition is only sufficient for the indicated property. A necessary and 
sufficient condition for the stability of the explicit, scheme with respect to 
the initial data in the space Ha is 


(15) 


2 

T - A’ 


where 


a 4 c. 


But it may happen that the coefficient k(x) varies very fastly. In that 
case the estimate A < 4 c 2 /h 2 is too rough and condition (14) gives a severe 
restriction. In mastering the difficulties involved, we are forced to apply 
the maximum principle to the weighted scheme (9) written in the canonical 
form for any a: 


(K3) (l + (a t + a i+1 )^yj+ l = {^^+1 + a i+1 yj+l) + F'( , 

h 2 ( a i + a i+i))yi 


F'!=[ i- (1 - cr)r 


+ 


(! "O' 

h 2 


( a M-i + ffi+i^+i) + r( p 3 t 


The boundary conditions j/(0) = y(l) = 0 together with Theorem 3 in 
Chapter 4, Section 2 for equation (16) give us the estimate 


l|y J+ 1 ll c <ll^llc- 
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The coefficient at the member yj becomes non-negative for 

h 2 


(17) 


r < 


2(1 - cr)c 2 ’ 
which assures us of the validity of the relations 

11^ lie < II?/ lie + T \\ l P : \\c 


and 

(18) l|y J+1 ll c < \W\\ c + T \W\\c < l|y°llc + J2 r ll^ , |lc- 

j '-0 

Summarizing, the weighted scheme (9) is stable in the space C, provided 
condition (17) holds. For the purely implicit, scheme with a = 1 estimate 
(18) is valid for any value of r. 

The accurate account of the accuracy is stipulated by more a detailed 
exploration of the residual 

■0 = A (a u + (1 — a) u) + <p — u t 

on the solution u of the original problem (l)-(3). Upon substituting the 
expansions 


it + it t _ t - „ ,, 

— 2 ~ + 2 u t = 11 + 2 u + 0(r 


ll + U T _ T - 

—2 - 2 Ut = U ~ 2 U + °^ T ^ 


- u + 0 (t 2 ) 


with the members 


,*' + 1/2 


du 

dt 


it is plain to calculate the residual 


, 1L U . . 

ip = A —+ (a — 0.5) r Au t + (p — u t 
= (A u + f - u) 

+ (A u — L u) + (tp — f) + (cr — 0.5) r A it + 0(t 2 ) 
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Taking into account the relations Lu + / — « = 0 and 

(19) A u = Lu + 0(h 2 ), <p = f+ 0 (t 2 +h 2 ), 
we arrive at 

(20) ip = (a — 0.5) r L ii + 0(r 2 + h 2 ). 

This supports the view that the order of approximation for a given value of 
a coincides with the order of approximation established before for the unit 
constant coefficient k(x) = 1: 

ip = 0 (t 2 + h 2 ) for a = 0.5 , 

■ip = 0(t + h 2 ) for c 0.5. 

Along these lines, the error of approximation z 3 = y 3 — u : , where y : is 
the solution of problem (7) and u = u(x,t) is the solution of the governing 
problem (1)—(3), can be most readily evaluated with the aid of the equation 


z t = A (az + (1 — cr) z) + ip , x £ ui h , t = jr > 0 , 
z(x, 0) = 0 , z(0, t) = z(l, t) = 0 . 

Some progress can be achieved by having recourse to relation (11), leaving 
us with the estimate 



Using the results obtained in Chapter 2, Section 3, namely the relations 

||z|| c <l(l,(z ? ) 2 ] 1/2 = |\/uz,z) 
and the estimate c l ||z||„ < ||z||^, we derive the inequality 


( 22 ) 



1 

2 y/2 e Cj 



thereby justifying by virtue of representation (20) that scheme (7) converges 
uniformly with the rate 0(h 2 + r m<T ), where 


2 for (7 = 0.5, 

1 for c yf 0.5, 

provided that the conditions hold under which the describing scheme is of 
accuracy 0(h 2 + r m<r ) and a > a e for 0 < e < 1. A similar conclusion was 
drawn in Chapter 5 for the relevant equation with a constant coefficient 
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4. The equation with a discontinuous coefficient of heat conductivity. In 

the general setting the convergence of the weighted homogeneous scheme 
(7) is of our initial concern. A case in point is that the coefficient k(x) has 
a discontinuity of the first kind on the straight line x = £ in the plane (x,t). 
Some consensus of opinion is that the usual condition of conjugation 

du 

(23) [u] = 0, \kj- ]=0 for x = £, t> 0, 

is fulfilled on every discontinuity line. In the physical language, this is a 
way of saying that the temperature u(x,t) and the heat flow (— ku') are 
continuous. 

By relating the functions k(x), f(x,t) and a solution u(x,t) to be 
sufficiently smooth everywhere except this discontinuous line we proceed to 
evaluate the residual (the error of approximation) 

4> = A (a u + (1 — a) u) + <p — u t 
— A ti 1 -' 7 ' + ip — u t , 
uW = a u + (1 — a) u . 

Let now £ = x n + 6h, x n — nh, 0 < 6 < 1, n > 1. As far as a three-point 
operator L is concerned, we might have 

(24) i/>j = 0(h 2 + T m ’) for all i ^ n , i ^ n + 1 . 

On this basis it remains to calculate ij.’i for ? = n and i = n + 1. Also, it 
will be sensible to introduce 

(25) h t/>„ = - i~u[ a) + hip n — h u t n , ^ = a u s i , 

Since 

(«%■)* = (k u ')i- 1 /2 + 0(h 2 ) 
for k g C'f 2 - 1 [ac,-_, xy] and u £ £,], we obtain 

(26) w n — (k u') n -i /2 + 0(h 2 ) 

= (& “Oleft ~ (^ + 0.5) h (k u')ieft + 0(h 2 ), 
where n left = v(£ — 0 ,t). By the same token, 

(27) h ip n+1 = + h <p n+l - h u t n+1 , 

(28) w n+2 = (a %) n+2 = (k u ') rig ht + (1.5 - 0) h (k u ')[. ght + 0(h 2 ), 



470 Homogeneous Difference Schemes for Time-Dependent Equations 


where ^. lght = v(£ + 0 ,t). 

Furthermore, using the expansions behind 

u n = u(i) -6h u[ e{t + 0.5 e 2 h 2 w" ft + 0(h 3 ) , 
u n+l = «(0 + (1 -e)h < ight + 0.5 (1 - 9) 2 h 2 < ght + 0(h 3 ), 

we find that 

™n + l = a n +1 %,n +1 = a n +1 + ( l ” 0 ) < lg ht) + °( /l ) ' 

As a corollary to the condition of conjugation [ku'] = 0, we might have 

( ku ')lett = ( ku ')n S ht = > 

so that 


“left “ 




^ left 


•ight 


^right 


(29) 


n +i ~ it. • i, 

^left ^right 


+ i- I w {£> 0 + 0(h) . 


Upon substituting (26), (28) and (29) into (25) and (27) we finally get 

/r0 n = QW + 0(h ), 


On — 


/ 0 1-0 

In + 1 l ^ ^ 1c 

V '‘•left might 




h ( 4>n + 4>n + 1) = + 2 “ + h (.Pn + p n + 1 ) ~ h K n + 1 + U t n ) 

= (1-5 -0)h{(k u ')' ri6ht ) (<7) + (0.5 + e) h ((k «0U) f<r) 

+ h (Pn + An + l) ~ h ( ^t,n + l “1“ ) + o(0 2 ), 

showing the new members to be sensible ones. The limiting values emerging 
from equation (1) are taken to be 

( k = (“ - f)x= f . ( k u ')'n e ht = (“ ~ /)*■=? > 

since [u] = [/] = 0 for x = 0 The next step in this direction is to insert 
the assigned values in the preceding expansions with further reference to 

Pn = fn + 0(h 2 + t 2 ) , ibO) = W + W + (cr 0.5) t , 
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making it possible to find that 

hii’n + V’n+i) = 2 h(u- f)^ +h(<p n +‘f n+l - U hn - U t n+1 ) + 0(h 2 ) 
= 0((a — O.b) t h + t’ h + h 2 ) 
and deduce for any weighted scheme of the form (7) that, 

(30) hip n = 0( 1), 

(31) h (ip n + ip n+1 ) - (a- 0.5) 0(t h) + 0(r 2 h + h 2 ). 

Under the special choice 

(32) a( x ) = a ( x )= (^j k{x + sh ^j 

it is straightforward to verify by analogy with the available procedures (for 
more detail see Chapter 3, Section 3) that 

Qn = 0(h) , htp n = 0(h) . 

From such reasoning it seems clear that the following estimates are valid: 

(33) = i), 

(34) h ( 0f, n + 1) = (<r - 0.5) 0(t h) + 0(t 2 h + h 2 ), 

thereby justifying the representations 

0 0 

i> = i> + xp *, i>i = 4>i (6 in +Si +1 ), 

(35) 

xp* = 0(h 2 + r m "), ip* = 0 for i ^ n , i ^ n + 1 , 

where 6f n is, as usual, Kronecker’s delta. 

The intervention of a new grid function 

Vi= E h k> Vi-0, i = 2,3,. ,. , N , 

k -1 
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arising from the representation 

0 

(36) ip = Vx + V* > that is, ip — i] x , 

gives rise to a perfect model for a more simpler estimation: 

for i < n + 1 , Vn+i ~ h <P n 


(37) 


Vi 


0 


h (ip n + ‘ip n+l ) for i > n + 1 . 

The order of accuracy of scheme (7) can be most readily evaluated 
with the aid of the representation for the error z — y — u as 

z = v + z* , 

where v and z* are solutions of the related problems: 


v t = A (crv + (1 - a) v) + ip , v 0 = v N ~ 0 , v(a?, 0) = 0 , 

z* = A (a z* + (1 - a) z*) + ip* , z* = z* N = 0 , z*(x, 0) = 0 . 

In the accurate account of v and z* we apply the results of the general 
stability theory (Theorems 9 and 11 from Section2, Chapter 6): 

(38) IK + 1 || <llW°ll + IM-V'll 

_L^ o 

+ 2^ r II II for a > a o, 

j'=i 

3 

(39) II z* 3 + l II < T II V 3 II for cr > a 0 , a> 0. 

j '=o 

0 , 0 
Since A~ 1 ip — ( is a solution to the equation A( = ip = rj x! we have 

occasion to use the relation 

(40) II < 

c l 

the right-hand side of which can be modified on account of (37) into 

N 

(1>M]= h l ?? il = b 2 l^nl + h lr„ + V’n+ll (f - X n + i) ■ 

i=n +1 
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By substituting estimates (30) and (31) into inequality (40) and, in turn, 

0 

estimates (33) and (34) into a similar inequality for ||A _1 i/> || and then 
applying estimates (35), (38), (39) and the inequality || z || < || z* || + || v || 
to the resulting expressions we establish the convergence of scheme (7) in 
the class of discontinuous coefficients, 


Let k(x) possess a discontinuity of the first kind for 
x — £ and conditions (23), (24), (30) and (31) hold 
simultaneously. Then for a > a 0 , a > 0, scheme (7) 
converges in the norm of the grid space L 2 with the rate 
0(h 2 + r m+<7 ), while the best scheme with coefficient 
(32) does the same with the rate 0(h 2 + r m+a ); m a = 2 
for a — 0.5 and m a = 1 for <7 ^ 0.5, 


A priori estimates obtained in Chapter 6, Section 2 provides the suf¬ 
ficient background for a> uniform estimate of accuracy in the norm of the 
grid space C such as 


(41) 


J+ 1 


<ll'0 ( 


+ H : 


(42) 


0 ■' 

+ r II IL- 1 for 

]' = 1 



for a > a e , 


where || z\\ 2 A = (Az,z) = (a, (z £ ) 2 ] and the inequalities (see Chapter 2, 
Section 3) are taken into account,: 

iMIc < \ (!»( z s) 2 ] 1/2 > Ikll^ = ( a > (%) 2 ] > C (1, (%-) 2 ] • 

In conformity with Chapter 2, Section 4 we deduce that 
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which in combination with (37) leads to 

M 2 = hi]l +1 +(l - x n+l )r, 2 n+2 

= h ( hip n ) 2 + (1 - x n+1 ) ( h(ip n + ip n+ 1 )) 2 , 

thereby justifying that 

||^|] = 0(Vh + T m<r ) for any scheme (7) , 

11] = 0(h 3 / 2 + r m<T ) for the best scheme with coefficient (32) . 

Having stipulated the same conditions (23), (24), (30) and (31) as 
before, scheme (7) converges uniformly with the rate 0(Vh + r m '): 

IMIc = \\y 3 ~ llj Wc = 0('/h + T m «). 

This estimate can be improved for the forward difference scheme with 
a = 1 by means of the maximum principle and the method of extraction of 
“stationary nonhomogeneities”, what amounts to setting 

z 3 — v J -f w 3 , 

where w 3 is a solution to the equation 

(43) A w = -tp = rj x , 
so that 

INIc < pr (!> M] - IK-llc - “ ^ ' 

c i c i 

Here v 3 needs to be recovered from the relations 

(44) v t +Av = xp, p) = -ip* — w t , v(x, 0) = — w(x, 0). 

In this regard, the maximum principle with regard to equation (44) yields 

Il^ +1 |lc7 < IK"°ll t 7 + t ^(llV^^llo + ll^fllc') • 

j' = i 

By inserting here the estimates for ||'«;|| ,, ||mi ( || c and ||'i/’*]| c we arrive at 
||i4|| c = 0(t + h) and, hence, |]z J || c = 0(t + h). For the scheme with 
the coefficient specified by (32), it retains the order of accuracy in the 
class of discontinuous coefficients as occurred before in the stationary case: 
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5. Homogeneous schemes on nonequidistant grids. There is no doubt that 
the users come across nonequidistant grids in both x and t variables in 
practical implementations of some or other problems. All the preceding 
results and estimates remain valid for the two-layer scheme being used on 
a nonequidistant in t grid. That is to say, the nonuniformity in t has no 
considerable impact in such matters and it should be taken into account 
only in the selection rule for the step r = Tj depending now on the subscript 
j. The order of approximation in t remains unchanged, but the symbol 

0(r m ) will stand either for 0(r m ) or for 0(( max where there is 

3 K i<i<i 0 3 ' 

no danger of confusion. The situation in which the grid is nonequidistant 
in x needs investigation by exactly the same reasoning as before. 


Let ui. 


U 


0 , 1 , 


, N, x n 


0, 


b N 


1} be an arbitrary 

grid on the segment 0 < x < 1 with steps h i = x t — x i _ 1 , i — 1,2,... , N. 
In line with established priorities from Chapter 3, Section 4 the operator 


Lu 


d / du 
dx V dx 


is approximated by the difference operator 


a-i+iiy+i ~ Vj) _ adVi ~ Vi- 1 ) 

hi+i h i 

with the same coefficients a t as was done on equidistant grids. This is 
acceptable if we take, for example, under the constraint —1 < s < 0 (see 
Section 2) 


A y= ( a Vs)i,i = j- 


(45) a { ■= A[k (xy. + s/q-)] or — = A 

a i 

The right-hand side is calculated by the simple formula 

( 46 ) ¥> = <?■ = - f(Xi,t), 

assuming f{x,t) to be a continuous function of the argument x. When 
some such function may have discontinuities of the first kind at the nodal 
points, the obstacles involved can be avoided by setting either 

l‘ t fi—o T h i+l f j _j— q 

’ 


1 

k(x i + sh i ) 


(47) 


A; = 
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where f l±0 = f(x i±0 ,t), or 

*1 + 0.5 

(48) <fi = £; = ^- j f(x,t)dx. 

*!- 0.5 

In order to clarify the main idea behind this approach, we turn to the 
scheme with weights 

(49) y t = A(ay + (l - a) y) + ip , +£+,,, 0 <t=jr<T, 

y(x,0) = y 0 (x) , x<Eu> h , y(0,t) = u^t), 2/(1, t) = u 2 (t) , 

A y = (a(x) y s )., 0 < q < a < c, , 

whose augmented form is suitable for subsequent calculations. The elimi¬ 
nation method unveils its potential once again and permits us to find y^ +1 
on every new layer t = f - +1 in terms of a known value y 3 on the current 
layer t = t,- : 


Ai - Ci yi + Bi y i+l = -Fi, 2 = 1,2,... ,7V — 1, 
Vo — u i(tj + i) i Vn = WUj+l) ) 


a a - t cr cl,-, t 

Ai = —-A- , Si = , l+ \ ■ , Ci = A t + Bi + 1, 

h i hi h i+l ^ 


(1 - (r) r 
h: 


hi h,:. 


(1 - cr)r T cgr/i-! flj +I & +1 

/h+i J ' 

Under such a choice of the computational algorithm the accuracy of 
scheme (49) will be given special investigation. We are going to show that 
it converges uniformly with the rate 0(h 2 + r m,T ) in the case of smooth 
functions k(x) and 

For this, we proceed as usual. This amounts to evaluating the error 
zj = $ — u\ , where j/) is a solution of the original problem (1)—(3) and 
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u(x,t) is a solution of the preceding difference problem. Upon substituting 
y = z + u into (49) the complete posing of the problem for the error z is 

z(x, 0) = 0 , xEu> h) z(0,t) = z(l,t) = 0 , 0<t = jr<T, 

(50) 

2 ( 21 , 0 ) = 0, xeuj h , 2(0, t) = z(l,t) = 0, 0<t=jr<T, 

where 

(51) tp(%, t) = A (a u + (1 — a) u) + tp — u 

is the error of approximation of problem (l)-(3) by scheme (49). In such a 
setting the balance equation on the segment 5 < x < x i+0 5 with the 
ends Xj_ Q 5 = x- t — 0.5 h ; and x j+0 5 = x { + 0.5 h i+1 gives 

+ ■''i + 0.5 

(52) j -^-(x,t)dx = w(x i+l) 5 ,f) - w(x t _ 0 5 ,i) + j f(x,t)dx. 

x 'i~ 0.5 ^2 — 0.5 


Here 


Bn 

w(x,t) = k(x) — (aqf). 


Some modification of the residual ip is possible with minor changes. Divid¬ 
ing both sides of identity (52) by /q = 0.5 (/?.,- + h i+l ) and then substracting 
the resulting expressions from (51) reveal 

ip - (a u( a) - k v!) „ . + C , 

v *'' ' X , l 

where v = v(x i _ 0 5 ,t) and 

•■Cj + O.S 

7 0 1 f dn - 

Vi = 'Pi ~ V i + -j- / —(x,t)dx-u t i . 

x i- 0 5 

Using an expansion arising from Chapter 3, Section 4 such as 
^i = fi + | (hr f i _ Q 5 ) i ^. + 0(h?) 
and allowing an alternative form of writing 
(53) ip = r]- + ip* , 

h 2 


Vi = a< - Mj-i/2 + f 4 - /')Li 


/2 


(54) 
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with ii' — d 2 u/dtdx and /' = df/dx incorporated, we arrive at 

r t = 0(h 2 + r 2 ) . 

It seems clear that representation (53) for the residual ?/> is an imme¬ 
diate implication of the balance equation (52) by observing that 

( ku '), +l/2 = ( ku, )i + 0 - 5h i+d ku X + l h hi(ku')"+ 0(h 3 i+1 ), 

( h ') M/2 = (*«'),■ -O.bh^ku')'. + ^h 2 (ku')" + 0(h 3 t ) 

and, hence, 


( ku')[ = - oV [*<+i (* — A f (* “O"] +°( h l 


i/2 J 8 h. 

By virtue of the relations 


V i — V i-l/2 + O(hi) , Vj — l'V+1/2 + 0(h l + l ), 

(k u!)' = u — f , (A: «') " — ii' — f 

the desired result will be substantiated if we succeed in showing that 

J— i h 'Ul v i - v i) = (Af «i-l/2)i,i + • 

n i 

An alternative form of the residual 


ip — A — u t — ((A; u') + / — u) t _ 

is best suited for our purposes in the applications of formula (54), thereby 
justifying the final results 

i] = 0.5 a (u £ + u s ) ~ ku' + t (a — 0.5) a u st + 0(h 2 ) = 0(h 2 + r m °’) . 


The next question we have, raised above is the accuracy of scheme (49), 
the accurate account of which can be done using a priori estimates of the 
problem (50) solution with further reference to the special structure (50) of 
the right-hand side of ip. Following established practice, we introduce the 
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space Q, = H of all grid functions given on the grid u> h and vanishing at 
the points x = 0 and x = 1 and then define several inner products by 

JV-l N -1 N 

(va)* - E y t v i h i, (y,v)= E (y,D] = E KhV 

2 = 1 2=1 i— 1 

In this direction we refer to the operator A : H H with the values 

Ay = —A y = — (a y f for any y £ H . 

We know that the operator A so defined is self-a.djoint and positive definite: 

A = A* >0, 

since (Ay, v) = (ay s ,v £ \ = (y,Av). By the same token, 


(Ay, y) =(ay s , y s \ > c x (y %, y s . 


I c = n raax w Nl < \ {y^y s ] iri < (Ay,y) 1/2 ■ 

0 <i<N Z Z ,/C, 


By obvious rearranging of the problem (50) solution a.s 

Z = V -)- 'W , 


where v is a solution of the same problem with another right-hand side 
0 = % and w is a solution of problem (50) with the right-hand side 0 = 0*. 
As can readily be observed, scheme (50) is stable under the constraints 


a > c, 


_ 1 1 




where h n = min h,-. 

0 l<i<N 

Other ideas are connected with a priori estimate (41) for v and esti¬ 
mate (42) for iv. When providing such manipulations and establishing the 
relation 


Ha -1 — 


INI, 
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where ||??]| = \J{ 1, if] and ||^|| < ||?;|| + \\iu\\, we get for a > cq, a e = 
0.5 — (1 — e)/{r\\ A ||), the estimate 



In what follows it is supposed that &(.r), f(x,t), t£ 0 (r), u i (t) and « 2 (0 
are smooth functions and the conditions under which 

(56) ?? = 0(H 2 + r'^), 1]t = 0{\h\ 2 + T m «), r = 0(\h\ 2 + r 2 ) 

hold. Then scheme (49) converges uniformly on any sequence of nonuniform 

grids {up,} with the rate 0(r m °- + |h| 2 ), where \h\ = max /i,, if a > a £ , 

l<i<N 

This fact follows immediately from the combination of estimates (55) and 
(56). 

We touch upon briefly the convergence of scheme (49) in the class of 
discontinuous coefficients and will pursue some analogy with the stationary 
case which has been considered on the same footing in Chapter 3, Section 
4 under the following assumptions: 

(a) the functions k(x) and ma Y have only a finite number of 

discontinuities of the first kind on straight lines parallel to the co¬ 
ordinate axis Ot ; 

(b) the grid Q h = Cb h (K) is chosen in such a way that all of the discon¬ 
tinuity lines of the functions k{x) and f(x,t) will pass through the 
nodal points; 

(c) the functions k(x), f(x,t) and u(x,t) have all necessary derivatives 
in the regions lying between the discontinuity lines so that formulas 
(53)—(54) and estimate (56) are still valid at all the nodes of the 
grid u n (I<). 

We note in passing that ip { is determined by formula (47), due to 
which scheme (49) converges uniformly with the rate 0(r m ^ + |h| 2 ) under 
the aforementioned conditions on sequences of special grids. 

Remark 1 Convergence in the norm of the grid space L 2 occurs with the 
same rate if condition c) is relaxed: 

r, = 0(\h\ 2 + r m ’) , 


(57) 


ij* = 0(\h\ 2 + T 2 ). 
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This fact follows immediately from a. priori estimate (42): 


U + i| 


< 


a/27 



1/2 


for a > <j £ . 


Remark 2 Uniform convergence with the rate 0(\h\ 2 + r) of the forward 
difference scheme with (7 = 1 can be established by means of the maximum 
principle and the reader is invited to carry out the necessary manipulations 
on his/her own. 

6. An one-point heat source. Of special interest is the nonstationary heat 
conduction problem in the situation when a heat source is located only at 
a single point x = £ under the agreement that at this point the solution of 
problem (l)-(3) satisfies the condition of conjugation 


[u] = 0 , 


*£]=-« 


for x = £ , 


where Q = Q(t) is a power of the heat source. 

The discontinuity condition of the heat flow 



is to be understood as the discontinuity property of the first derivatives 
du 

k —. That is to say, the solution u = u(x,t) has a week discontinuity on 
ox 

the straight line x = £ by relating at the same time the coefficient k{x) and 
the function f(x,t) to be smooth enough. 

By means of the integro-interpolation method it is possible to con¬ 
struct a homogeneous difference scheme, whose design reproduces the avail¬ 
ability of the heat source Q of this sort at the point x = £. This can be 
done using an equidistant grid u> h and accepting £ = x n + 6h , 0 < 6 < 0.5. 
Under such an approach the difference equation takes the standard form 
at all the nodes x i yf x n [i yf n). In this line we write down the balance 
equation on the segment a : n _ 1( / 2 < x < ® n +i/2 f° r fixed t = t = tj +Q5 . 
With the aid of the relations 

*'11 + 0.5 / *n + 0.5 


/ ( ku')'dx 


(ku')'dx + 


J, n-0.5 


■ 1; n-0 5 


(k u'Y dx 


fcuT "- 0 ' 5 

x n + 0.5 


[ku 1 ] 


w n + 1/2 w n- 1/2 


-0, 


w = ku 1 , 
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we arrive at 

x n + l/2 

(59) J -^(x,i)dx = w(x n+1/ n,i)-w(x n _ 1/2 ,i)-Q(i) + h<P n . 

■ l 'n-l/2 

The usual transition to a difference equation leads to 

Vt = A y {a) + for x = x n , 

where Ay = (ay x ) x . 

Summarizing, the difference scheme for the problem described by (1)- 
(3), (58) is of the form 


(60) y t = A y [a) + f + jp Q(t) 6 i n , 0 < x = aq < 1 , t = t j > 0 , 

Vo = ffi - 2/w = ff 2 . 2/(*,0) = m 0 (®) , 

where <5 ; n is, as usual, Kronecker’s delta. 

For the error z = y — u we have equation with the right-hand side 

(61) 4> = Au (a) +<p+^~ Q(t) 6 hn -u t 
and the boundary conditions 

(62) z 0 = 0, z N - 0, z(x, 0) = 0 . 

On account of the balance equation (59) the residual is representable by 

(63) ip = i] x + ip* , rj = a u^ — ku‘ 

/ Wi + 0.5 

o j If du 

( 64 ) ^ J ~Qf{ x ^) dx 

x i— 0.5 

Here we adopt tq = i’(aq_ 0 5 ,f) as was done before. For the sake of .sim¬ 
plicity we take 9 < 0.5, that is, x n < £ < x n+l / 2 , permitting us to deduce 
that 


?q = 0(h 2 + t rn *) for all i ^ n + 1 
■tp* = 0(h 2 + t 2 ) for all i yf n . 
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By analogy with the case of discontinuous coefficients we find that 

%',n +1 = 6 “left + (1 ~ “right + h t( 1 “ “right ~ ^ “left] + 0(h“) ■ 

Since a n+l = k(£) + (0.5 — 8) h k'(£) + 0(h 2 ), we might have 

a n + l U x,n + L = ^ w left + (1 — ^) w right + 0(h) • 

With the aid of the relations 

“bight — “deft — —Q . (k u ')n + l/2 = “bight + h (0-5 — 8) {k M^nght + 
we establish 

(65) Vn+l =0Q +0(h) = 0(1) 

by observing further that 

(66) r n = 0(h). 


The accurate account of the error z can be done as in Section 4, 

0 

leading to the same rate of convergence. No progress is achieved for a = a 
in line with approved rules, because the choice of the coefficient should not 
cause the emergence of a higher-order accuracy. From the formula i] n+l = 
8Q+0(h) it is easily seen that rj n+l = 0(h) and, hence, || z || = 0(h 2 +r m,r ) 
if 6 — 0, meaning that the heat source is located at one of the nodal points. 

This guides a proper choice of the nonequidistant grid u> h (Q) so that 
the heat source will appear at one of the nodal points. When this is the 
c.a.se, scheme (60) converges uniformly, on the same grounds as before, with 
the rate 0(\h\ 2 + r m,T ). But a special choice of the coefficients a t given 
by the formulas of the truncated scheme with second-order accuracy (see. 
Chapter 3, Section 7) improves our chances of constructing the difference 
scheme, of accuracy* 0(|/i| 2 + T m ”) for any Q £ [0,1], that is, disregarding to 
the possible locations of the heat source. 

7. A concentrated heat capacity. We now consider the boundary-value 
problem for the heat conduction equation with some unusual condition 
placing the concentrated heat capacity Co on the boundary, say at a single 
point x — 0. The traditional way of covering this is to impose at the point 
x = 0 an unusual boundary condition such as 

du du 
~dt = k dx ’ 


(67) 


x = 0 , 


Co = const > 0 , 
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thereby completing the statement of the problem under consideration: 


( 68 ) 


du 

— = Lu + f(x,t), 0<x<l, t> 0, 




Lu= d^{ k dx)' 

du du 

Co = k — for x = 0 , u(l,f) = 0, u(x, 0) = u 0 (x) . 


The design of a homogeneous difference scheme necessitates approxi¬ 
mating the boundary condition at the point x = 0. 

The first step during the course of the integro-interpolation method is 
to rely on the balance equation, say in the rectangle {0 < x < x^ 2 = 0.5 h, 
tj <t < t J+1 }, leading to 



) — u(x, f •)] dx 


o 


t i +1 t j +1 ' T i/2 

j [ w ( :l 'i/ 2 C) ~ W (0,t)] dt + j J f(x,t)dxdt, 


where w(x,t) = k 


du 

dx 


The next step is to substitute here 


2 ( 0,0 


, du 


C. !«).<) 


and take into account that 


t j + i 

/ du 

Co -^(0,f) dt = Co (u(0, 0 + i) - m(0 dtj)) = CuTu tfi . 


Then upon replacing the integrals in x by the simplest expressions 0.5 hu 0 
and 0.5 h f 0 and the integrals in t by the expressions rOjj, and the 

difference boundary condition is taken to be 

(69) C y t 0 = < 2 j + 0.5 h , C=C o + 0.5/ l . 
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In this way, the difference scheme 

(70) y t — K t/' 7 ) + <p , 0 < x = ih < 1 , t = jr > 0 , 

CVtfi = a i yi\o + °-5 h /'o <7 ' ) i <>0, y N =(i 2) 2 /(.r, 0 ) = m 0 (k) , 

is responsible for problem (68). It is plain to recover from the condition at 
the point x = 0 that 


(71) 


y 0 = ih + c , 


aa l T 

a a l t + C h 


Vi — h [0.5 hr + eq (1 - cr)Ty xfi + Cij]/(C h + a, <rr) , 

yielding 0 < < 1 for a > 0. In turn, the boundary condition of the first 

kind is imposed for i = N: 


(72) y N - n 2 . 

With these, for determination of y i = j/) + 1 we obtain a second-order 
difference equation supplied by the boundary conditions (71)—(72) that can 
be solved by the standard elimination method. 

The intuition suggests that in such a setting the governing difference 
equation and the boundary condition at the point x = 0 have one and the 
same order of approximation 0(r m ^ + h 2 ). To make sure of it, it suffices 
only to evaluate the residual 

'Pv - C u t fi - cq - 0.5 h / 0 (<7) . 

Substituting here the expressions 

a i u x,o = ( a %-)i = ( k «')i/2 + 0{h 2 ) 

= (k u') 0 + 0.5 h(ku'y 0 +O(h 2 ), 

(k u') 0 = C 0 k 0 , ( k u')' = « 0 - f 0 , 

yields 

4> v =c K i0 ~ ^ } ) + 0(h 2 ) = 0(r m ' + h 2 ) 
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as required. 

For the error z — y — u we may set up the related problem 


(73) z t = A y [a ' i + ip , ip = A 1 P ' 7 ' 1 + op — tt t , 0 < x < 1 , 

C z i 0 = eq + E > Uv = 0 , z(z, 0) = 0 . 

One obvious way of proceeding is to introduce the space H of all grid 
functions defined on Co h and vanishing for i = N. Under the inner product 
structure 

N-l 

[y> v ) - E Vi v i h + Q -5hy 0 v 0 

8=1 

we refer to operators A and D acting in accordance with the rules 


i A y)r = — (A y)i 

for 

0 < i < N , 

o 

II 

a l Vx-fi 

0.5 h ’ 

( Dy)i = iji 

for 

"< 

V 

V 
o 

( D y) o = 

0.5 A 


With the detailed forms in mind, problem (73) can be recast as 

(74) Dz t +Az^ = ip, t = jr>0, z(0) = 0, 

showing the new members to be sensible ones. All this enables us too write 
B = D + a t A. 

From the general operator theory outlined in Chapter 2, Section 4 it 
seems clear that the operator D is .self-adjoint and positive definite: 

D > c„E , where c* = min (1,2 Cj h) . 

However, this is certainly so with the operator A: 

A = A* > 0 . 


What is more, the operators A and D are commuting: AD = DA. Due to 
these properties the stability condition for scheme (74) is expressed by 

B - 0.5 r A = D + + (a - 0.5) r A > 0, 


which is valid only for 


a > 0.5 


c* 


More a detailed proof of convergence of this scheme is concerned with 
the form (74) and a priori estimates obtained in Chapter 6, Section 2 and 
so it is omitted here. As a final result we deduce that scheme (70) converges 
uniformly with the rate 0(r m,T + h 2 ). 
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8. The case when the coefficient of conductivity k depends on t, k = k(x, t). 
So far we have preassumed for the sake of clarity that the coefficient of 
conductivity k depends only on one variable x. 

In a common setting the governing equation (1) of the general form 

Wt = £) 0 < c i ^ MM) < c 2 > 

is put together with the boundary and initial conditions (2)-(3). In prepa¬ 
ration for this, the intention is to use instead of (6) another difference 
scheme 


( 75 ) y t = A(t)y^+cp , 

where A (t) v = (a(x,i)v s .) , t = f. + 0 5 and the coefficient a(x,t) for fixed t 

appears by exactly the same reasoning as before (see Sections 2 or 4 of the 

present chapter). The error of approximation ip of the scheme concerned is 

of 0(r m,T + h 2 ) if k(x,t*) £ C'( 3 )[0, 1] for every fixed t = t t and this is also 

consistent with the results obtained. 

In mastering the difficulties involved, we refer to a variable operator 
0 

Apt) in the space <b> = H of all grid functions with the values 
Ay= —Apt) y , y £ Q, . 

In connection with its dependence on t the usual practice is to impose, in 
addition, the Lipshitz condition with respect to the variable t\ 

| ((-4(0 - Apt - r)) y, y) \ < r c 3 (Apt - r) y, y) , 

making it possible to apply the general stability theory. As can readily be 
observed, the Lipshitz condition is ensured if 


\k(x,t) — k(x,t — r)| < t c 3 k(x,t — r), 


thereby confirming the validity of the preceding results obtained in Sections 
2-4 for scheme (75). 

Further development of this trend of research is devoted to a more 
complex problem in which the governing equation acquires the form 


c(x, t ) 


dt 


£(*<«,<)§*)+«».<) 
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with c(x,t) > Cj > 0 and 0 < cq < k(x,t ) < c 2 . In view of this, the 
corresponding homogeneous difference scheme becomes 

(76) p(x,t)y t = A(t)y^+ip(x,t), 


where p and <p are calculated by means of the same pattern functional 
P{ x iJ) = c ( x iJ) or p( x id) = I (c(»j — 0, t) + c(x i + 0, <)) in the case where 
c(x,t) is discontinuous at the node x = x i . 

With the detailed forms of these functionals, scheme (76) is stable 
under the constraints 


a > a 0 (t) , 


= I „ c i 
2 t || A(t) || 


l|A|| = ||A||. 


Because of this fact, it is unconditionally stable for a > 0.5. 


Remark So far we have considered only equidistant grids in t. But it is not 
difficult to show that the preceding estimates for two-layer schemes remain 
valid on nonequidistant grids with step Tj = t- — tj_ i being a function of the 
subscript j. It is obvious that the grid in t is rather flexible in comparison 
with the grid Lo h as a result of refining the step Tj in the regions of the 
widely varying right-hand side /(*,<), boundary values /.q(f), p 2 (t) and 
the coefficient k = k(x,t) in t. With knowledge of the behaviour of the 
problem solution on a sparse grid, successive grid refinement will be caused 
by the necessity of diminishing the step Tj in some intervals during which 
the solution varies very fastly in t. Any changes in the composition of the 
grid Lo h with changes of tj in the process of calculations are connected with 
indeterminate values of the function yj at new (additional) nodes of the 
grid co h in view. 

For example, a greater gain in accuracy in r will be achieved once 
we perform parallel calculations on several grids w and by the rules 
approved in Chapter 3, Section 4. 

The forthcoming procedures serve to motivate what is done on an 
equidistant grid Lo hT , on which the representation takes place: 


(77) y! = d + a l3 h m1 + % C + 0{h m * + r"’) , 

m 2 > rn 1 > 0 , n 2 > n x > 0 , 
where a i • and f3 i3 are independent of h and r both. 
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Let y hTi (x l ,t,-) and t/ ft7 _ 2 (xq, fy) be solutions of the same difference 
problem with different steps iq = r and r 2 = r. Via the linear transform 

y hT (x,t) = c 1 y hTl {xJ) + c 2 y hT2 (x } t) , t = jr , j = 0,1,..., 

with expression (77) standing for y hT and y !lTri both, it is necessary to 
reduce to zero the coefficient at the member r” 1 . All this enables us to find 
with reasonable accuracy 


y = u + 0(h m2 + r n2 ) 


the values 

c 2 = 1 - c x , Cl =-l/(2 n >-l). 

A similar procedure works on two different grids u> h and u> 0 5ft for fixed r, 
thus causing a grid solution y such that 

5 = u + 0(h m2 + r n ' 2 ). 

When providing current manipulations, the solution u = u(x,t) and the 
available data of the original problem are preassumed to be smooth enough 
and sufficient for the existence of the asymptotic expansion 

y nT =u + a h m1 + p r ni + 0(h m2 + r n =). 

9. The third boundary-value problem. For the moment, the statement of 
the problem is 


Lu + f(x, t ), 

L„= 

. du\ 

0 < x 

ao/chgtl 

= A(f)w(0,<) - 


A >o, 

-an) du{ !' ,) 

= P 2 (t) u(l,t) - 

~ 1^2 ) 

P 2 > 0. 


In Chapter 3, Section 5 we have formed a difference equation of the 
third kind for the stationary equation Lu + f = 0. The formal passage 
from the stationary equation to the nonstationary one is provided by the 
replacement of / by / — du/dt. This trick has been already encountered in 
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specifying the difference conditions approximating the boundary conditions 
of the third kind. The outcome of this is 

y t = A{t) [a y + (1 - a) y) + p , 0 < x t = Hi < 1 , tj = jr > 0 , 

a i(i) + (! - = Pi(i) {<ry 0 + (1 - cr) 2/o) + lh(i) 

+ 0.5 h y t 0 — a N (t ) (<r y s N + (1 — cr) 2/ g>J v) 

= P 2 (t) {vVn + (! - c) %v) + /M<) + 0.5 . 

Here fl 1 = pq (<) — 0.5 h /(0, <) and p 2 = (t") — 0.5 /i /(1, t) for i = tj +0.5 r. 

The resulting scheme is of accuracy 0{t 2 + h 2 ) for a = 0.5 and it is of 
accuracy 0(t + h 2 ) for a > 0.5. 

The best possible choice for later use of the elimination method is due 
to 

y 

A(0 y - =-F , y 0 = x 1 y 1 +v 1 , y N = x 2 y N _ l + p 2 , 

a r 

where 


_ (hit) _ 

a x {t) + hp^t) + h 2 /{2 a r) ’ 

_ a N (J) _ 

a A r (^") T h b 2 (i) + h 2 / (2 a t) 

(i - - PS)Vo) + °- 5 h yJ T ~ fh 

a { a i(i)/h + P l (t) + h/(2cr t)) 

(! -?){-a N {i)y StN - (3 2 (i)y N ) + 0-5 h y N /r - p 2 
a (a N (t)/h +P 2 (t) + h/(2a T )) 

F = ((! - <r) A(f) y + y/r + <p(t)) a^ 1 . 

Having completed the elimination, we observe that the computational pro¬ 
cedure is stable if a > 0, because 0 < Xj < 1 and 0 < x 2 < 1. 




10. Monotone schemes for parabolic equations of general form. It is re¬ 
quired to find a solution of the following problem foor a parabolic equation 
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of the general form in the rectangle Dt = {0 < ac < 1, 0 < t < T}: 


(78) c(x,t) = Lu + f(x,t ), 

u(0,f) = Uj(f), u(l,f) = u 2 (t ), -u(k, 0) ='t£ 0 (x’), 



0 < Cj < A:(k, <) < c 2 , c(k, <) > Cj > 0 , q> 0. 


A similar problem has been solved in Chapter 3, Section 5 for the stationary 
equation Lu + f = 0 through the use of monotone schemes of second-order 
accuracy attainable for any step h and the function r(x’). 

In order to construct a monotone scheme for problem (78) for which 
the maximum principle would be valid for any h and r, we involve in subse¬ 
quent considerations the equation of the same type, but with the perturbed 
operator L: 


du ~ ~ d (, du\ du 

(79) c 7 ,, = *-^.^ + , 

= (1 + 77)- 1 , R=0Lh\r\/k. 

As usual, the operator L is approximated for fixed t — t = tj+i /2 by the 
difference operator 

A y = x{a y s ) x + b + a {+1 '>y x + b~a y s ~dy , 
where (for more detail see Chapter 3, Section 5) 


a = A [k(x + .sh, <)], d — F [q(x + .sh, <)] , = C[r ± (x > + sh, <)] , 

r ± = r ± /k, r + = 0.5 (r + |r|) > 0 , r~ = 0.5 (r — |r |) < 0 . 

Here the same pattern functionals A and F are adopted in achieving much 
progress as was done in Chapter 3, Section 2, making it possible to generate 
an approximation of order 2. 
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To equation (79) there corresponds the purely implicit (four-point) 
homogeneous scheme 

(80) p(x,t)y i = A(t)y + ip , 

y(x, 0) = u 0 (x) , 1 /( 0 , t) = u 1 (t) , y(l,f) = u 2 (t) , 

where the coefficients p and <p are calculated by the same formulas as before 
for d and . A special structure of the operator A built into this scheme 
results in the error of approximation ip = 0{t + h 2 ) and may be of help in 
achieving this aim. 

The maximum principle applies equally well to the estimation of the 
problem (80) solution with zero boundary conditions y 0 = y N = 0 in tack¬ 
ling the governing equation in the canonical form 

{Pi/ T + a i + Pi + dp Vi — a z y i _ l + fa y i+l + C) , 

Fi = PiVi/r + ipi, a { = -hb~)/h 2 , fa = a t+l (x 8 - + h b+)/h 2 . 

The conditions of Theorem 3 in Chapter 4, Section 2 are easily verified for 
this equation, due to which we might have 

F 

Pile = n ^ x „ l&l < n ’ D i = p i /T+d i . 
u<i<yv jj q 

Substituting here the appropriate expressions for T) and Di yields 

\\y J+ 1 \\ c <\\y 3 \\c + - - <ll^llc +file'll. 

Pc C 

which assures us of the validity of the estimate 

ll^ +1 |lc<l|y°llr+" E r H^ , |lc- 

1 j '=o 

This provides enough reason to conclude that scheme (80) converges uni¬ 
formly with the rate 0(t + h 2 ). 
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11. Cylindrically symmetric and spherically symmetric heat conduction 
problems. In explorations of many physical processes such as diffusion 
or heat conduction it may happen that the shape of available bodies is 
cylindrical. In this view, it seems reasonable to introduce a cylindrical 
system of coordinates (?\ p, z) and write down the heat conduction equation 
with respect to these variables (here x = r): 


(81) 


dii 

dt 


i d_ 

x dx 



du 

dx 


+ f(x,t ), 


In the physical language, this is a way of saying that the temperature 
is independent of ip and z. 

In the case of a spherical symmetry the heat conduction equation 
acquires the form 


( 81 ') 


du 1 d 
dt x 2 dx 


k(x, t)x 


du 

dx 


+ f(x,t). 


Homogeneous difference schemes for stationary equations in spherical and 
cylindrical coordinate systems have been designed in Chapter 3, 

Still using its framework, the starting point correcting that situation 
is to impose at the point x = 1 the usual condition of the first or third kind 


(82) u(l,<) = p 2 (t) 

and then require the boundedness of a solution at the point x — 0: 

f)n l 

lim k x — = 0 for (81), lim k x 2 — = 0 for (81 7 ). 
x-*o dx x-*o dx 

The cylindrically symmetric heat conduction problem is reproduced by 


(83) 


du 

dt 


= Lu + f(x,t ), 



< > 0, 0 < a: < 1, 

u(x, 0) = u 0 (x ), 0 < x < 1 , 


x k 


du 

dx 


= 0 , 

x* = 0 


u(l, t) — f-i 2 (t ), t > 0 . 


In line with the usual practice we introduce on the segment 0 < x < 1 an 
equidistant grid 


{x i = ih , i = 0,1,.. . , N , hN = 1} 



494 Homogeneous Difference Schemes for Time-Dependent Equations 


and a time grid ui T = {tj = jr , j = 0, 1, , , , } on the segment 0 < t < T to 
expound exploratory devices for obtaining difference schemes by analogy 
with Chapter 3, 

The operator L is approximated by the difference operator 
Hi) u i = ~ (•'C-i/2 • ~ Lu , where a { = a(x { ,i) , 

x i x ' 1 

thereby establishing a correspondence between equation (83) and one of the 
weighted schemes 


Vt = A (t)y [a] + , <p= f(x , i) . 

The complete posing of this includes the difference boundary condition 
at the point x = 0. The methodology of Chapter 3 furnishes the justifica¬ 
tion of the forthcoming substitutions into the stationary equation: we first 

( (^ X/ \ '[b 

f - -g]~j x _ 0 and then b y u t and u b y 

y. The outcome of this is 

„ i{) J a '> — ~ v _ h. fl» 

“ilC Vx,o — ^ Vt ,o ^ ./ 0 1 

which admits an alternative form of writing 

vt ,o = i a iyi a ,o + v>o, v 0 = f { 0 a) ■ 

In this regard, we observe that it is possible to insert /(0, i) in place of 

When the conditions for x = 1 and t = 0 are put together with the 
preceding equation, their collection constitutes what is called the difference 
b o u n d a.r y- v al u e. p r o b 1 e m 


y t = A (t) i +<p , 0 < x = ih < 1 , < = jr > 0 , 

2//v =/C > V( x > '0) = « o (*), x ^ Q h> 

where 

4 

A(<)y = fOT * = 0, 

A(<) y = — (x a(x, t) y f .) _ for 0 < x = ih < 1 , x — x { — 0.5 h . 
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If a yf 0, then the difference equation related to y i can be solved by 
the standard elimination method, 

The statement of the problem for the error z = y — u amounts to 

z t = A(<) + ip , 0 < x = ih < 1 , t,j > 0 , z 0 = 0 , z(x, 0) = 0 , 

where ip = A(f) lA”) + ip — u t . By exactly the same reasoning as in Chapter 
3, Section 5 the residual ip is representable by 

4> = ^ (•£’ v) x + 4* + 4** , V = « - ( k u') x=Si t= t , 

with the members 

i] = 0(h J + r m,r ) , ip* = 0(h 2 /x) , i/ 1 ** = 0(h 2 + r") . 

Having no opportunity to touch upon this topic, we refer the readers to 
the aforementioned chapters of the manograph “The Theory oof Differ¬ 
ence Schemes’’, in which the method of extraction of “stationary nonho¬ 
mogeneities’’ was employed with further reference to a priori estimates of 
z. The forward difference scheme with (7=1 converges uniformly with the 
rate 0(h 2 + r) due to the maximum principle. 

Being concerned with the heat conduction problem in the case, of 
a spherical symmetry, we are now in a position to produce on the same 
grounds the difference scheme associated with problem (81')—(82): 

y t = A (t) j/' 7 ) +tp for 0 < x = ih < 1, tj > 0 , 
f/yv = A *2 - i > 0 . V( x i . 0) = u 0 (.c), x t G 0 J h , 

where 

Mt) Vi = -4 a ( X i ’ fe,*),. ■ for i > 0 > 

X ■ x ) 1 

% 

. 6 
A(<)i/ 0 = , 

<Pi = or ^ = 4 <7) for 0 < i < N . 

This is also consistent with the results expounded in Chapter 3, Sec¬ 
tion 5. The standard elimination method applies equally well to such a 
setting. We omit here more a detailed exploration of the residual and the 
accurate account of accuracy of the describing scheme. The reader is invited 
to do this on his/her own in line with established priorities for difference 
schemes on “flowing” grids iO h . 
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12. A periodic problem. We are now interested in the problem of the heat 
distribution over a uniform thin circlic ring 0 < p < 2i: of radius r 0 \ 

d u o\ 2 d 2 u 

^7 = 725 ^ 2 - 0 < ^> < 2 7 T, f'> 0 , u(p, 0 ) = U 0 (ip) , 

A unique determination of a solution u(p,t') necessitates imposing 
the condition of periodicity 

u(p + 2ir, t') = u(ip, t') for any p £ [0, 2 7 r] , 

which, in turn, can be replaced by the condition of conjugation at the point 
ip — 0 : 


dn 

dp 


du 

tp=o+u dp 


cp = 2 7 t —0 


u (0 + 0 , t') = u(2 ir - 0 ,t '), 

By interchanging the variables 

x = p/(2i r), i — a 2 t'/(2irr 2 


the segment 0 < p < 27r is carried into the segment 0 < x < 1. In view of 
this, the governing equation is modified into 


du d 2 u 
dt dx 2 


0 < * < 1 • * > 0 , u(x, 0 ) = u 0 (x ), 


z (0 + 0 ,f) = u(l - 0 ,t), 


<9u(0 + 0 , t) du(l — 0 , t) 


dx dx 

which is not surprising. On the grid 

Co h = { x i — ih, i = 0, 1,... , N, h = l/N) 

we have occasion to use the simplest implicit scheme 

y t - y Tx , 0 < x = i h < 1 , t = j r > 0 , y(x, 0 ) = u 0 (x) , 

which is supplemented by the condition 


Vo = Vn 
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as a corollary of the condition of conjugation u(0 + 0,t) = u(l — 0, <). By 
analogy with Chapter 3, Section 5 the .second condition of conjugation is 
approximated by the equation y 0 t — y Sx 0 . By identifying the endpoints 
x = 0 and x = 1 it is supposed that 

Vn+i — Vi ■ 

In accordance with what has been said above, the difference scheme 
in question is constructed at all the nodes i = 1 , 2 ,... , of the grid ui h 
under the periodicity condition y N+ j = y N imposed at the node i = N. 

The same procedures are workable in constructing the appropriate 
difference scheme associated with the equation with variable periodic coef¬ 
ficients 


du 

dt 



0 < x < 1 , 


t > 0 , 


u(x, 0 ) = u 0 (x) , 0 < x < 1 , 


and the boundary conditions of periodicity that are known to us as the 
conjugation ones: 


u(0 + 0, t) = u(l — 0, t) , 


du du 

dx a—o+n dx 


Here all the functions k(x,t) t f(x,t) and u 0 (x) are periodic of period 
1 so that 


u 0 (x + 1 ) = u 0 (x), f(x + l,t) = f(x,t) , k(x + l,t) = k(x,t) . 

Let us stress here that the available coefficients A:(0+0, t) and Ar( 1 —0, t) 
may be different: £;(0 + 0,<) yf k(\ — 0 ,t). When this is the case, the 
derivatives du/dx involved happen to be discontinuous: 

<9w(0 + 0 , t) du(l — 0 , t) 
dx dx 

By identifying the endpoints x = 0 and x — 1 on the same grounds as 
before, the condition of periodicity is to be understood as the condition of 
conjugation at a discontinuity point of the coefficient k(x t t). From such 
reasoning it seems clear that, having stipulated the condition Jpv+i = Vi, 
the design of the scheme in question includes all the nodes * = 1,2,... , N 
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of the grid at hand. As a final result we get the homogeneous difference 
scheme with weights 


y t = A(f)-t/^ +<p(x,t) , x = ih , i = 1, 2,. .. , TV , f = (j + 0.5) r , 
y{x, 0 ) = u 0 (x ), y N+l = y 1 , y 0 = y N , 

where Ay = (a(x’,t) y^) and the coefficients a and ip are given by the usual 
formulas. For example, it is fairly common to deal with 

G = Em/2 - Vi = °- 5 (/;-o + fi+o) ■ 

The solution can uniquely be found from the above conditions. This scheme 
has the approximation order 0((cr — 0.5)r + r 2 + h 2 ). 

In these concerns, there arises the problem for determination of y — 

y J ' +1 : 


Aim -1 - Bijji + A, + l y i+l =-Fi, i - 1.2,.. . , N , 

Vn+i = m . y 0 = ilN, Ai = ar ajti 1 , C7* = Ai + A t + 1 + 1 , 

which can be solved by the cyclic elimination method established in Chapter 
1, Section 2, 

In an attempt to cover all the issues, we should raise the questions 
of stability and accuracy for the approximation just established. With 
this aim, we introduce the space H of all grid functions y(x i ) given for 
i = 1,2,, .. , N, N + 1 and satisfying the condition of periodicity y N + 1 = y 1 , 
y N = y 0 . An inner product and associated norm in that space are defined 

by K w) = Emi v i w i h and IE II = v/Et)- 

The operator A is specified by the relation 
Ay = — A y for y G H . 

It seems clear that Green’s formulas are certainly true in the case when 
the operator A is defined in such a way. Moreover, A — A* > 0. All 
this provides the sufficient background for the possible applications of the 
general stability theory outlined in Chapter 6 , within the framework of 
which the scheme concerned is unconditionally stable for a > 0.5. 

For ( 7=1 the maximum principle is in full force for any r and h, 
due to which the resulting scheme is uniformly stable with respect to the 
initial data and the right-hand side. What is more, the uniform convergence 
occurs with the rate 0(r 2 + h 2 ). 
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7.2 HOMOGENEOUS DIFFERENCE SCHEMES 
FOR HYPERBOLIC EQUATIONS 

1. The original problem. In a common setting it is required to find in the 
rectangle 

D t = [0 < x < 1] x [0 < t < T] 

a solution of the first boundary-value problem for a second-order equation 
of hyperbolic type 


(1) 

d 2 u 

- Lu + f(x,t) , 


d ( 

du\ 

w z 

Lu — 


di) 

(2) 


u(x, 0)= 

u 0 (x) , 

d u 

= WoO 

(3) 


li(0, t ) : 

= > 

-«(!,<) = 

ll 2 (t) 


0 < Cj < k{x, t) < c 2 , 


where Dt = (0 < x < 1) x (0 < t < T], under the following assumptions: 
the problem is uniquely solvable, its solution is continuous in the closed 
domain Dt and possesses all necessary derivatives which do arise in the 
further development, the coefficient k(x,t) and the right-hand f(x,t) may 
have discontinuities of the first kind on a finite number of straight lines 
parallel to the axis Ot (“immovable discontinuities”), on every discontinuity 
line x = fp., s = 1,2, .. . ,s 0 , the conditions of conjugation relating to the 
continuity of the functions it and k du/dx for x = , s = 1, 2,.,. , .s 0 , must 

hold: 

(4) [u] = u(£ s + 0 ,t) - u(£ s - 0,f) = 0 , [k du/dx] = 0 . 

2. Homogeneous difference schemes. In preparation for designing a homo¬ 
geneous weighted scheme associated with problem (l)-(3), let 

^ h — {^i ' ^ 0, 1 , . . ■ , iV , X'q — 0 , X jy — 1} 

be a nonequidistant grid on the segment 0 < x < 1, lu t = {tj = it, 
j = 0,1,2,... ,j 0 } be an equidistant grid on the segment 0 < t < T and 
let a suitable grid in the rectangle Dt be made up by ui hT = tu h x ui T . A 
homogeneous difference scheme for solving problem (l)-(3) can be obtained 
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for fixed t £ ui T through the approximation A u + <p = (a(x,t) Ug) ,+ ip to 
Lu + f. The forthcoming replacements d 2 u/dt 2 \ t=:t ~ and Lu + f ~ 
A (tj) w ( CTi,CT =) ^ where 

a(i’ 2 ) = oyti + (1 — <r 1 — og) u + a 2 u , 

Htj)u = (a(x,tj)ug)., 

u = u 3 , u — u 3 ~ 1 , u = u 3+1 , 

complement subsequent constructions. As a final result we obtain the ho¬ 
mogeneous weighted three-layer scheme 

(5) K{t 3 )y (ai ' a2) + ip . 

The coefficient a can be taken on the middle layer t — tj. 

Substituting y — y + ryo + 0.5r 2 y t - t and y = y — ry<> + 0.5r 2 y t - t , where 
V° = (y - 2 /)/( 2 t ) and y (1 = (y - 2y + y)/r 2 , into (5) yields 

2 / (<7 ‘ ,CT2) = y + K - o- 2 ) r y° + o.5(o-i + <y 2 )T 2 y- u , 

which admits an alternative form 

(6) (E - 0.5 (o-j + a 2 ) t 2 A) y u — {a i — a 2 )r A. y= = Ay + p, 

where if is the identity operator. For cr l — <x 2 = <x it becomes the symmetric 
scheme 

(7) (E - (XT 2 A)y {i = Ay+ >p(x,t) , 0 <t=jr, 

which will be given special investigation in the sequel. 

Before going further, we must append to (7) the initial and boundary 
conditions. These depend on the range of variables; thus, the boundary 
conditions and the first initial condition are specified exactly: 

(8) y(0,t) = u^t) , y(l,t) = u 2 (t) , y(x, 0) = u 0 (x). 

There are two ways of approximating the second initial condition 
du/dt | i = 0 = u 0 { x ), one of which generates an approximation of order 2 
in r: 


(9) y t (x,0) = u 0 (x) , where u 0 (x) = u 0 {x) + 0.5 t(Lu 0 + f) t=0 ■ 
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The second one is connected with the difference equation for determi¬ 
nation of y(r): 

(9') (E - o-t 2 A(0)) y t (x, 0) = u 0 {x) + 0.5r(Aw o + f(x, 0)) . 

Summarizing, the homogeneous difference scheme (7)-(9) or (7), (8), 
(9') is put in correspondence with the original problem (l)-(3) under con¬ 
sideration. 

The computational procedures for three-layer schemes were estab¬ 
lished before. For their successful realization we need to know the values y* 
and y 3 ~ 1 on two preceding layers for searching y — y> +l by the elimination 
method being used on every new layer t = t- + i in solving the boundary- 
value problem with respect to y = y 1 + L : 


(10) (E - (TT 2 A)y = F , 0 < x = ih < 1 , y 0 = u 1 , y N -u 2 , 

Fit) = 2 y-y- r 2 A ((2 a - 1) y - a ij) + r 2 <p , t>r, 

F( 0) = u 0 + r 2 (0.5 — a) A(0) u 0 + tu q (x) + 0.5 r 2 f(x , 0). 

3. The error of approximation. Let u(x,t) be a solution of the original 
problem (l)-(3) and y(x i ,tj) — Vi be a solution of the difference problem 
(7)-(9). The next step is to set up the difference problem for the error 


11 

— m] , where u) 

= u{x it tj), by inserting in (7)-(9) the sum 

(11) 

{E — a t 2 A) 

zj t = A c + i>{x,t.) , 0 < x < 1 , t > 0 , 


z(x, 0) = 0, 

N 

O 

11 

N 

II 

O 

o 

ii 

where 



(12) 

ip(x ,t) 

= A (t)u- u,t t + ar 2 Au u , 


v(x) - 

0.5 t(Lu 0 + f) t=0 +u 0 (x) - u t (x, 0) 


are the errors of approximation on the solution of problem (l)-(3) associ¬ 
ated with equation (1) and the second initial condition (2), respectively. 

If the coefficient k(x,t) and the right-hand side f(x,t) possess only a 
finite number of immovable discontinuities, the grid uj h — uj h (K) will be so 
chosen that all discontinuity lines will pass through the nodal points (the 
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main idea behind this approach was explained earlier in Chapter 3, Section 
4 and Section 1 of the present chapter). 

For convenience in analysis, the residual ib is representable by 

(13) = r) £ + ip*, 


where 

(14) % = a iUs;i 


k—) 
dx) i-l/2 


l( d J. 

8 \dx 


d 3 u \ 

dt 2 dx ) i- 1/2 


(15) ip* = 0(t 2 + h 2 ). 


Apparently, the current situation needs certain clarification. Having inte¬ 
grated equation (1) with respect to i at a fixed moment t = t • from 
1° x i+l/2 



k 

dxJ^-o.s 


1 + 1/2 


f(x,tj) dx 


- 1/2 


'1 + 1/2 


- 1/2 


d 2 u(x,t j ) 

W 2 


dx = 0 , 


we then divide this identity by Hf, subtract the resulting expressions from 
the right-hand side of representation (12) for the residual ip and, finally, 
get 

(!7) 4> l = + o-T 2 a i u nSii - (fc - u tt,i + Pi 


1 


ft/ 


x i + 1/2 

f (fi*’*})- 


d 2 u(x, t,) 
dt 2 


+ — 1/2 


dx , 


where the coefficients cq and ip i are given for fixed t = tj by the same 
formulas as stated in Chapter 3, Section 4. 

Let x. t be a discontinuity point of both functions k and /. To avoid 
cumbersome calculations, the usual practice involves the simplest formulas 
for finding a { and (p i : 


(18) 


-1/2) Pi 


h ifP 


H +1 


ft 


2 hi 


ft = f(x { ± 0). 
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Following the procedures of Chapter 3, Section 4 and taking into ac¬ 
count that the second partial derivative d 1 ujdt 2 is continuous on the line of 
discontinuity x — ( of the functions k[x,t) and f(x,t), we deduce through 
such an analysis that 



Because of this, formulas (13)—(15) are an immediate implication of formula 
(17) with the preceding expansion involved. From representation (14) it 
seems clear that 

(19) Vi = 0{h 2 + T 2 ), Vt.i = 0(h'j+ t 2 ) . 

4 . Stability and convergence. No restrictions are made regarding the 
smoothness of the coefficients and the solution in the further estimation 
of the accuracy of scheme (7)—(9). This can be done using various a priori 
estimates for the operator-difference three-layer scheme 


(20) D zj t + A z = 'ip(t) , t = ir > 0 , 

^(O) = 0, z t ( 0) = is. 

Here D and A stand for linear operators in a Hilbert space H, z(t ) and i/>(f) 

refer to abstract functions of the argument t £ ui T with the values in the 

space H and v is an element of the space H (for more detail see Chapter 6). 

0 

In preparation for this, H = Q is the space of all grid functions given on 
the grid ui h and vanishing on the boundary at the points x = 0 and x = 1. 
The usual inner products are defined to be 

JV-i N -i N 

(2, C 1 )* Z l V i fl i , (2, t) 2 ; v i H { , (2,^] • 

1 i — 1 1 

In the general setting three types of suitable norms are in common 
usage: 

INI c = max \z(x )\, || z || = \/{z,z) , || 2 || = \/(Az,z) . 

xEaj h 
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A comparison of (7) and (20) provides enough reason to conclude that these 
operators A and D are identical: 

A = - A, D = E - a t 2 A = E + a t 2 A . 

The operator A is self-adjoint, positive definite and satisfies the estimate 
(see Chapter 2, Section 4) 

II A II < 4 c,//t 2 ■ , /i n , in = min /?.,■ . 

N 11 — Z! mm 5 rn i n <. < ^ i 


The general stability theory outlined in Chapter 6 asserts that scheme (20) 
is stable under the condition 

D > t 2 A or (By, y) > r 2 (Ay, y ), 

where e > 0 is an arbitrary number independent of h. We will pursue the 
further stability analysis of this with 


D 


1 + £ •> , ( 1 + £ \ 2 a 

- t 2 A = E + tr-r 2 A 

4 V 4 / 


> 


\A\ 


rr-l±i)r 2 j A >0, 


which is certainly true for 


a > cr. 


1 +1 


h 2 


4 4r 2 c, 


If you wish to explore this more deeply, you might find it helpful to 
refer to Chapter 6, Section 3 of the monograph “The Theory of Difference 
Schemes”, in which the following estimates were derived for problem (20): 


( 21 ) 


IC + 1 ! 


U(«.) 


, 1 T £ 

< Ml - I IIz, 


«WllD(r) 


T \\i ,k 


k = l 




( 22 ) 


\z j + 1 \ 


Mu) - 


< Mt/— I I|z, 


(^dlD(r) 


+ max 
o <k<j 


fcii 

1 l ' A ^Uk) 


A \ t k) 
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For the weighted scheme (20) these estimates are ensured by <x > <x e and 
M < c 3 a. 

We shall need yet, among other things, some modification of the well- 
known estimates on an equidistant grid (see Chapter 2, Section 4), taking 
on an arbitrary nonequidistant grid the form 

INL>hh lh]|>hh IMIc> 

(23) IhIL-i = IhIL-i < -4= INI, 


< — ||)/i]| for -0 


Since D is a self-adjoint operator and 

D = E + <x t 2 A = E + (<r — cr £ ) r 2 A + <x £ r 2 A 


> E + 0.5 t 2 A - A> eE, 


we obtain 


Ul 


D 1 <-E and \\ip\\ D -i < ~ || 0 || . 

£ u S 


As usual, we may attempt the solution z of problem (11)—(13) as a 
sum z = v + iu with the members v and w satisfying the conditions 


i’t> = A «' l5) + i].t - ^,c,0) = v t (x,0) =0, v o = v N = 0, 

(24) W j t = hwA') + -0* , w(x, 0) = 0 , 

w t (x, 0) = v{x) , w 0 = -w N = 0 . 

Putting these together with (21)—(23) we deduce for v and w that 

(210 ||C + 0l c <™ max (l|hll +ll^']|), 

(220 + 

where ||^||^ = ((E + a r 2 A) v,v) * = \\v\\ 2 + ffT 2 (fl,0]. 
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Theorem Let the functions k(x,t) and f(x,t) have discontinuities of the 
first kind on a finite number of the straight lines x = £ s , s = 1 , 2 ,. .. , s 0 
parallel to the axis Ot and in the regions of the special configurations 

A s = (£, < x < £ s+1 , 0 <t < t : ), s = 0,1,... ,s 0 , £ 0 = 0, £ So+i = 1, 

the coefficients k(x, t) and f(x, t) and the solution u(x, t) are smooth enough 
so that both conditions (19) and (15) hold true. Then under condition (22) 
scheme (7)-(9) converges uniformly with the rate 0(r 2 + h 2 ) on special 
sequences of nonequidistant grids ui h (Ii) and the solution of problem (11) 
satisfies the estimate 

(25) \\z 3 \\ c = ||?/ — if \\ c < M (r 2 + h 2 ) , where h 0 = max . 

To prove this assertion, it suffices to bring together a priori estimates 
(21)—(22) with relations (15) and (19). 

Remark The theorem is still valid upon replacing (7) by the scheme 

(26) {E- (xt 2 A) yp = Ay+ <p, 


where the constant operator Ay = y s % is adopted as a regularizer. In that 

0 

case A — —A, R — — cr A and D = E + t 2 R. The sufficient stability 
condition (21) is ensured if we agree to consider 

(27) <r = (l+e)c 2 /4. 

In evaluating the error of approximation all the tricks and turns remain 
unchanged except for formula (14) for rj, in which the member <rr 2 aM i - ig 
should be replaced by ar 2 Uf ts> where a constant cr is specified by (27). 



Difference Methods for Solving 
Nonlinear Equations 
of Mathematical Physics 


In this chapter the new difference schemes are constructed for the quasilin- 
ear heat conduction equation and equations of gas dynamics with placing a 
special emphasis on iterative methods available for solving nonlinear differ¬ 
ence equations. Among other things, the convergence of Newton’s method 
is established for implicit schemes of gas dynamics. 


8.1 DIFFERENCE METHODS FOR SOLVING 

THE QUASILINEAR HEAT CONDUCTION EQUATION 

1. The stationary problem. To avoid misunderstanding, we concentrate 
primarily on the simplest problem, the statement of which is related to the 
stationary heat conduction problem with nonlinear sources: 

(1) u" = — f{u) , 0 < x < 1 , u(0) = 0 , u{ 1) = 0 . 

An excellent start in this direction is to introduce on the segment 
0 < r < 1 ail equidistant grid Cb h = {x i = ih, i = 0, 1,.. . , N, hN = 1} and 
proceed to design the difference scheme 

(2) y Sx = —f(y) , x = ih , i = 1,2,. .. , N - 1 , 

Vo - Vn = 0 , 
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making it possible to set up the difference problem for the error z = y — u: 


(3) z Sx + f'(y) z = -ip , x-ih, i - 1,2,... , N - 1 , 

z o = Z N — 0 , 

where, y = u + 9z, 0 < 0 < 1, and ip = u. gJ . + f(u) is the residual. 

It seems clear that scheme (2) generates an approximation of order 2: 

ip = 0(h 2 ) . 

If f'(y) < 0, then a solution of the difference problem (3) satisfies the 
estimate 


( 4 ) M c <\m C ’ 

which serves to motivate the uniform convergence of scheme (2) with the 
rate 0(h 2 ): 

Me = lb — u llc- = °( /l2 ) • 

What is more, a solution of the difference problem (2) is bounded, so that 

(5) \\y\\ c < |/(0)| = c 0 

under the constraint f'(y) < 0. Indeed, simple algebra gives 

m = /(o) + {m - /(o)) = m+f\y) y , 

where y — 9y,Q<9< 1, yielding 

y Sx + f(y) y = -/( 0 ) - y 0 = vn = 0 • 


Whence estimate (5) follows on account of (4). 

In this regard, Newton’s method suits us perfectly in connection with 
solving the nonlinear difference equation (2). It is worth recalling here its 
algorithm: 


fc+i 

y xx 




y) = -f(y), 


where k is the iteration number, k = 0, 1,2, . . ., leaving us with the three- 

& + 1 

point linear difference equation related to y : 


= -(f(y)- f{y)y) > 


k + 1 

Vn 


= 0. 


tr\ k+l I xU k \ k+1 

( 6 ) vsx + f(y) y 


k + 1 

Vo 
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This can be solved by the standard elimination method, whose computa¬ 
tional procedure is stable under the condition f'(y) < 0. 

The convergence rate of such iterations needs investigation with regard 
to the error 

k +1 + i 


y 


y , 


where y is the exact solution of problem (2). Upon substituting two sub¬ 
sequent iterations y = y + v and y = y + into equation (6) we may 
set up the problem for the error l v L : 


(7) 


k + L , A , k + i 

V xx + j ( y ) V 


k 

~F 


fc + i k+ i 

v 0 = V N 


( 8 ) f = f(y)~ f(y) + (v-y) f\y) ■ 

Taking into account the well-established decomposition 

f(y) = f(y) + ny)(y-y) + lf > ( k y)(y-yf 

k k k 

where y = y + 9{y — 2 /), 0 < d < 1, we find that 


k 

F 


1 \ k 2 

i/ (y)v 


Thus, it is required to evaluate a solution of the problem 


(9) 


A’ + l , _ 1 f 11 (~ A k 2 A: + l A + i 

v Si : + ./(?/) V ~2 J iy) V ’ V 0 — V N 


0. 


If f(y) is a concave function, that is, f"(y ) > 0, then due to the 
maximum principle we might have 


k +1 k +i , „ k + l 

v = y - y < 0 , y <y, 


thereby clarifying that the iterations approach the exact solution of problem 
(2) from below. It is plain to show that for a solution of problem (9) either 
of the following estimates 


( 10 ) 


^ 1 ilc = l6ll/ // (^)llc-il- 


1‘J 1 Hr: <? II" 



510 


Difference Methods for Solving Nonlinear Equations 


is valid under the condition ||/ // (y)|| c = 16 q. 

Indeed, in conformity with the maximum principle (for more detail 
see Chapter 4, Section 2) problem (9) has for f'(y) < 0 the majorant 

V(x) = Iix(l-x), \\V(x)\\ c < \ K , 
where I\ - | ||/"(l/)|| c • \\v || 2 ,, so that 


I<:+11 

v 


c - 


c<^\\ny)\\c -\\v\\l<<i\\v\\l 


With the chain of the relations || c , < ||?'y||^ < 

view, we deduce that 


< ll?i 


111 


C+l|i ^ l|i 0 ,|2 fc + 1 
V \\ c < - qv 
q 


'c 


thereby confirming the quadratic law of the convergence of iterations with 
the initial approximation y subject to the condition 


9 111) 


< 1 or q | 


< 1 


When f{y) > —Cj, c l > 0, an alternative estimate in the grid norm of the 
space L instead of (10) is such that 


( 11 ) 

where 


iru/)i 


|*+i || < \\j _\vj\\c 


2 (<5 + cj 


|£|| 2 = 


Qi 


|£|| 2 


6= V Sm 2 


,7 rh , 1 

^ and 


9i=2llAi/)ll c 


Other iterative methods apply equally well to problem (2). Among 
them the method with the recurrence relation 

= 9 Vs* - (i - d )f(y) 


will be appreciated. Here the parameter 0 is given by the formula 
A c* 

8 = VTT > A = 47 - c * = max \f{y )\; 

A + 1 Lb y 

in so doing the iterations converge with the rate of a geometric progression 
with denominator q 2 = 9 , so that 


k + i 

v 


< ?2 


< q 


k + L 


It is worth noting here that the iterations converge no matter how the initial 
approximation y is chosen, because 9 < 1. 
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2. The quasilinear heat conduction equation. So far we have considered 
merely the linear heat conduction equation in spite of the fact that in plenty 
of real physical processes the coefficient of heat conductivity is, generally 
speaking, a nonlinear function of temperature (and density). In some prob¬ 
lems it gives, in addition, a function of the temperature gradient. High- 
temperature processes in plasma physics are in line with these statements. 
Being the right-hand sides of the heat conduction equation, heat sources 
may depend on the temperature when, for example, the heat transfer is 
caused by a. chemical reaction. Such processes are described by the nonlin¬ 
ear heat conduction equation 


( 12 ) 


de(x, t, u ) 
dt 


dw 


where the heat flow 


/ du\ 

w = w \ z - t - u --J 


is a nonlinear function of temperature u and its derivative. If the heat flow 
is linearly dependent on the derivative du/dx and it is governed by the 
Fourier law 

, / , du 

w = —k(x, t.u) — , 
ox 


we obtain a.s a final result the quasilinear heat conduction equation 


, , s du d / , , <9u\ 

(13) c(x,t,u) — = — \k{x,t,u) — j + f(x,t,u) , 

c(x, t, u) > 0 , k(x, t, u) > 0 . 

When this is the case, the heat capacity c, the coefficient of conductivity k 
and the right-hand'side / depend on the temperature u(x,t). In inhomoge¬ 
neous media k, c and / may have discontinuities of various kinds and this 
dependence upon the temperature u may be different and depends on the 
range of situations to be considered. 

In this view, it seems reasonable in a typical situation when the func¬ 
tions k = k(u), c = c(u) and / = f(u) depend only on the temperature u 
and give rise to the govering equation 


(14) 


cW ^ = ^( tw s) + /( “ ) 
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to introduce a new variable v = fg k(£) d£ for later use in equation (14) 
with further simplification of the ensuing formulas. The outcome of this is 


dtp(v) d 2 v 

dt dx 2 


+ f(v) , where ip(v) = / c(£) dt ; , 


By merely setting v = c(£) d£ we are led to an alternative form of 

equation (14): 

dv d / , s dv\ s 


so that 


m ~ d~v\ xiv) dx) + f(v) ’ 


x(v ) dv — / k(u) du 


When c(u) and k(u) can be expressed through the power functions of 
temperature u, that is, 

c(u) — c 0 u a , k(u) = k 0 u,P , 

it makes sense to introduce one more variable 


c(Od£ = c 0 


and take into account that 


du _ k dv _ k : p_ a dv _ k : /a + 1\ fqf x+r dv 

dx c 0 u" dr, c 0 dx c 0 V c 0 J dx 


permitting us to recast equation (14) as 


dv d j dv \ ~ 


(3 — a 


k 0 ( ct + 1 \ t+i 


3. Some analytical solutions to tile quasilinear heat conduction equation. 

Nonlinearity of the coefficient of heat conductivity results in the new physi¬ 
cal effects, the main of which is a final velocity of heat conducting. In what 
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follows we expound some exploratory devices for obtaining the simplest 
particular solutions to the equation 

, du d ( „ du\ 

(15) «=&(*"” ai)' *" >0 ’ <T>0 - ‘ >0 - 

Here the subsidiary information is the temperature at the point x = 0: 


(16) u = u 0 t n . 

With these, it is required to find a solution to equation (15) in the domain 
{x > 0, t > 0} with the zero initial temperature 

(17) u(x, 0) = 0 , 

We may attempt a solution of this problem in the form of a “travelling” 

wave 

u{x, t ) = U ( Dt — x) , D — const , 

where f/(^) is the unknown function which is sought. Inserting this expres¬ 
sion in (15) and taking into account that 

du dU du dU 

dt dl ; ’ dx d£ 

we derive the ordinary differential equation for the function U (£): 

DU' = {x 0 U a uy , 


yielding 


x.g U° U' = DU + const . 


In the case const = 0, we obtain 


x n -U a U' = DU 


or = 

D a 


which upon integrating once again becomes 

it u ° = t +c °- 

Since U = 0 for t = x = 0 (£ = 0), we find that c 0 = 0 and 
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whence it follows that at the point x = 0 

A comparison with (16) gives 


l/o 


1 


D 2 1 


Thus, we have proved by having recourse to a “travelling” wave that prob¬ 
lem (15)—(17) is solvable and its solution admits the form 


(18) u(x,t ) 


u 0 t 1/a 

0 , 


x \ 1 ! a 


Dt 


nfcW-x) 11 *, 0 <x<Dt, 

x > Dt, 


provided the condition n = l/<x holds. Any solution of the form (18) is 
called a “temperature wave” with a finite velocity. What is more, it 
depends on three parameters x 0 , <x and u 0 in accordance with the law 


D = 


X 0 K l a ■ 


At the next stage we focus our attention on the heat flow 

7/ <7 + 1 


w = —x n u 


du 

dx 


a D 1+1 l a 


( Dt-x) l l° = 




In view of this, on the front of the temperature wave x — Dt the tempera¬ 
ture and heat flow vanish for a > 0 and the partial derivative 


du u 0 1 

dx crD l / a (Dt — r) 1 ~ 1 / <7 


tends to oo for <x > 1, it is finite for a = 1 and becomes zero for 0 < <x < 1. 
Therefore, it is meaningful to speak for a > 1 only about a generalized 
solution to the heat conduction equation (15). 

A case in point is a nonlinear dependence of the coefficient of heat 
conductivity upon the temperature. From the formula for D it is easily 
seen that we formally have D = oo for the linear heat conductivity when 
a = 0; meaning that the velocity of heat conducting turns out to be infinite. 
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It may happen that the temperature front is held fixed, that is, D = 0. 
Such a solution always exists in a special boundary regime such as 

(19) u(0, i)= u o ■ 

where t 0 is an arbitrary constant, under the agreement that the initial 
condition was imposed for t — —oo: 


(20) u(x, —oo) = 0 . 

Still using the framework of the method of separation of variables, a solution 
to equation (15) is sought in the form 

u(x,t) = v(x) T(t) . 


Upon substituting this product in (15) and separating the variables we 
obtain 


Id/ a dv\ _ 1 dT_ 

v dx V 0 dx) T a+1 dt ’ 

where A is a separation parameter. Whence it follows that 


( 21 ) 


d 

dx 


dv 

dx 


— A v = 0 , 


( 22 ) 


dT 

dt 


A T a+1 


Along these lines, we may attempt a solution to equation (21) in the 

form 

v a = a (aq — x)@ , 

where the numbers a and f3 are free to be chosen and x 1 is an arbitrary 
number. Substituting v a into (21) yields 


x 0 a 1 + 1 ! a ~ (- +P- l) {x, -xfl a+l3 ~ 2 - Aa 1 /'^ -xf> a = 0 
u V a / 

and reveals 


Having integrated the equation related to T: 

T(t)= [cr A (c 0 — t)] ~ 1/<? , 
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where c 0 = const, we find the function in question 


2 \ l/° 


but minor changes are needed in complying it with the special boundary 
regime (19): 

/x^a\>/ a / x?a \L/ a 

c„ = i„, «„ = ( 7X j = ( 2 *. ((r + 2) J 

and, therefore, 

x\ - 2x 0 (ff + 2 )u a J(T . 

Thus, equation (15) with the special boundary regime (19) possesses 
the solution 


(23) 


u(x, t) 


u 0 

0 , 


1 — x/x 1 \ 2 / <7 

Vto ~t ' 


0 < x < x j, 
x > x x , 


where aq is the width of the region of the heat distribution. 

As a matter of fact, the front of the temperature wave becomes im¬ 
movable, since x x — const is independent of t and depends only on the 
parameters x : , cr, u 0 of the problem concerned. Moreover, at the front the 
heat flow and temperature vanish for any cr > 0, while the partial deriva¬ 
tive becomes du/dx = oo for a > 2 (at the front of the “travelling” wave 
du/dx = oo for a > 1). 

A solution known as a “staying wave” exists during the interval of 
time t < t : . This is stipulated by the special boundary regime (19) relating 
to the regimes with “breaking down”. 

For the heat conduction equation with a heat source depending oil the 
temperature in accordance with the law 


(24) 


■q 0 u 


P 


du _ d / a du ' 
dt dx \ 0 dx - 
there exist both types of the aforementioned solutions which fall within the 
category of travelling waves for f3 < <7+ 1 and the category of staying waves 
for P = a + 1. 

Numerical solutions of such problems cause some difficulties during 
the course of many methods in connection with nonlinearity and tendency 
to infinity of the partial derivatives at the front of the temperature way. It 
is hoped that the exact solutions obtained in such a way help motivate what 
is done and could serve in practical implementations as “goodness-of-fit” 
tests. 
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4. A difference scheme. Newton’s method. We now proceed to constructing 
difference schemes for the quasilinear heat conduction equation. 

For this, it seems unreasonable to employ explicit schemes with fastly 
varying ingredients k(u), c(u ) and f{u). The power functions of tempera¬ 
ture reflect in full measure the difficulties involved in such a case. For any 
implicit scheme one possible stability condition 

r 1 min c[u) 
h 2 — 2 max k(u) 

is connected with successive step refinement in f to a considerable extent. 
Quite often, it depends on the values of k and c in a smaller number of nodal 
points. This supports the conclusion that explicit schemes are useless for 
our purposes. In an attempt to fill that gap, a considerable amount of effort 
has been expended in designing unconditionally stable implicit schemes. 

In order to understand some things a little better, the governing equa¬ 
tion is put together with the boundary conditions 


(25) 


dp(u) d 2 u 
dt dx 2 


0<x<l, 


u(x, 0) = u : (x), u(0,t) = fi^t) , u(l,t) — . 

A nonlinear difference scheme with respect to y 2 + l 


( 26 ) = & 

x = a:,; =*/?., 0 < i < N , hN = 1, 

may be employed in such a setting under the conditions ip'(y) > c 1 > 0 and 
\ip" (t/)| < c 2 , providing its stability and convergence in the space C with 
the rate 0(r+ h 2 ). The proof of these assertions is somewhat lengthy and 
cumbersome and so it is omitted here. 

The nonlinear equation 

<P(y j + l ) ~ TVit 1 = fill 2 ) 

is aimed at determining y 2 + l on every new layer by making several iterations 
of Newton’s method 

<p(y) + p'{y)(y l -y) =<p(y j ). 


(27) 
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Under the boundary conditions 


( 28 ) 


i + i 
Do 


/h (tj + i 


k+i _ 

Vn ~ 




the elimination method is quite applicable in giving y . There is no doubt 
that its stability is ensured by the condition 


<p'(y) > 0 ■ 


Indeed, this fact is an immediate implication of an alternative form of 
writing the governing equation 


t k+i 2ru + i r k+i _ k 

y i~l~ { i P (Vi)+ Vi + Y 2 Vi + 1_ F i ’ 
i = 1,2,.. . , N - 1 , 

where - ip(y) - ip(y) - ip>(y )y and y - y>. 

The rate of convergence of iterations can be evaluated by means of 
the difference 

v i — Vi ~ Vi ’ y* — vi 

This can be done by inserting y { = y { + ^ and S/) 1 = + M) 1 in (27) 


v'{y ) k v 1 ~ T k v l sx = <p(v) -f(y) + f > (y)v+T i/ Sx 


k k k 

= ‘fiv) ~ i p(y) + , p , (y){y - y) 

and taking into account the basic relation 

f(y) = i p(y) + i p'(y){y-y) + ^"(y^ii-y) 2 

and its corollary 

<p(y) - p(y ) + ‘p'iv )(y ~y) = k ?"($) * 2 > 

where y — y + 9v , 0 < 9 < 1. The outcome of this is the equation 
(29) <p'(y) k v 1 - t I 'v\ 1x = p *?"(t/) v 2 = F . x = ih , 0 < i < N , 



The quasilinear heat conduction equation 


519 


with the homogeneous boundary conditions 

k+i 


(30) 


k + L „ 

Vn - 0 I 


U N 


= 0. 


In this regard, the maximum principle states that 


(31) 


, t + r, 


r , < 0.5 \\ip" [y]/ip'(y ] 


\ k II 2 ^ „ \\ k l|2 

t IU < s It IU 


where q = 0.5 \\y" {y) / y'{y )|| c < 0.5 \W{y)\\ c /c l < 0.5 c. 2 /c 1 = q 0 , since 
<p'(y) > c i > 0 and \ip"(y)\ < c 2 . 

Using this estimate behind, it i.s not difficult to establish that for the 
convergence of iterations in accordance with a quadratic law, it suffices to 
choose the initial approximation so as to satisfy the condition 

(32) \\y -y\\ c <2cJc 2 . 

The meaning of this is that we should have for the choice y = y = yi 

T \\y t \\ c < 2 c i / c 2 , 

which is always valid for sufficiently small r. 

In practical implementations Newton’s method converges with any 
prescribed accuracy s only if 


¥>(y) = y a , « < l, <p'(y) = a y a 1 


<p"{y) = — a (1 - a) y a 2 . 


If y > 0, then c 7 = oo and unfortunately the preceding estimates are 
meaningless. 

However, due to the maximum principle a solution of the boundary- 
value problem (29)—(30) is non-negative: 


k + l 
V 


fc + 1 

y 


y < o, 


k+l 

y 


< y, 


provided the condition ip"(y) < 0 holds. The preceding justifies that the 
iterations approach the solution from below. Because of this tendency, the 
first iteration is such that y < y if the initial approximation was taken so 
that y < y. But it may happen that y < 0, thus terminating subsequent 
computations. 
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5. Various implicit schemes for the quasilinear heat conduction equation. 

Other ideas are connected with two types of purely implicit difference 
schemes (the forward ones with <x = 1) available for the simplest quasi¬ 
linear heat conduction equation 


(33) ^ = 0<x<1 ’ 0<f<T, 

u(x,0) = u 0 (x) , u(0,t) = n 1 (t), u(l,t) = u 2 (t) , 


where k(u) > 0. 

The structures of both schemes are well-characterized by 


(34) 


Vi ~ Vi _ 1 

r h 


^+i(y) - “Ay) 


Vi - Vi-1 


f{Vi 


for the scheme a) and by 


(35) 


y % - Vi = i_ 
r h 


l i +1 


(y) 


Vi+i ~ Vi 

h 


- a-ity) 


Vi - Vi-1 


h 


f(Vi) 


for the scheme b), where y i — y{ +1 , y { = j/), a t (v) = a(r i „ 1 , v { ). For 
example, we might agree to consider 


(36) 

a-i{v) = 0.5 (k(v { _ i + k(v { )) 

(37) 

/ V; , + V; \ 

CM 

1 

II 

cT 

(38) 

2 k{vi-i)k{vi) 
aAV) k{v^ ) + k(v l )' 


A greater gain in accuracy in connection with the temperature wave 
depends significantly on how well we calculate the coefficients a^v). In 
the case where k = k 0 u a is a power function of temperature, numerical 
experiments showed that formula. (38) is useless and formula (36) is much 
more flexible than (37), so there is some reason to be concerned about this. 
Further comparison of schemes (34) and (35) should cause some difficulties. 
Both schemes are absolutely stable and have the same error of approxima¬ 
tion 0{t + h 2 ). The scheme a) is linear with respect to the value of the 
function y 3 + 1 on the layer tj + 1 and so the value y 3 + 1 on every new layer 
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tj + 1 can be found, for example, by the elimination method in terms of the 
values of the function jd on the current layer i ■. Because the scheme is ab¬ 
solute stable, the well-founded choice of the step r is stipulated by accuracy 
reasoning only. Unlike the preceding scheme, the scheme b) is nonlinear 
with respect to the value of the function jd + i , so there is a real need for 
employing the iterative method. Still using its framework, the iteration 
process is governed by the rule 


(39) 


U+0 

y i - Vi 

T 


1 

h 


A S ), 

u+i( y ) 


U+i) 

Vj ±i 


h 


U+i) 

y i 


+) 

~ a i(y 


(3 + 1) u + u 

y i - y »-i 

h 


f A s ) 

■f\y i 


As a final result of such operations a revised scheme becomes linear 

. . 5+1 v v v 

with respect to the value of the function y and only the initial approx¬ 
imation y remains as yet unknown. One way of avoiding this obstacle is 

to accept y = yi. We note in passing that most of the iterative methods 
converge in practical implementations for rather broader classes of coeffi¬ 
cients k and / after two-three iterations performed. Even if the process 
in view is divergent, two iterations can result in improved accuracy of the 
describing scheme. In trying to adapt the iteration scheme (35), (39) the 
usual practice is connected with specifying the condition 

1(3+1) 0 ) I 

max V i~ yA <e , 

l 

where either the total number of iterations is known in advance or a desir¬ 
able accuracy e is beforehand prescribed. 

Let us stress here that the iteration scheme (35), (39) requires the 
double storage in comparison with the scheme a). This is caused by the 

necessity of calculating and saving the values of the function y in terms 

S 

of the values of two functions y and y. 

One more difference lies in the fact that the transition from the value 
y to the value 3 y is possible only after several iterations made in scheme 

j +1 

(35), (39), while the value y immediately follows in the algorithm of the 
scheme a). 

But it would be erroneous to think in light of the same properties of 
the indicated schemes such as their absolute stability and the same order of 
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approximation that the scheme a) offers in such matters more advantages 
than the scheme b). 

Practical implementations showed that the computational procedures 
of the scheme b) can work with a larger step in time, thus reducing essen¬ 
tially the total volume of computations and the time complexity despite 
the extra iterations required in this connection. 

However, a preference relation between such schemes is some consen¬ 
sus of opinion. The reader can encounter in the theory and practice various 
schemes generating approximations of order 2 in time and space: 

Vt = \ [(“(y) Vg)x + («(?/) Vs)x] + ' 

As can readily be observed, they are not monotone, thus causing some 
“ripple”. This obstacle can be avoided by refining some suitable grids in 
time. When solving equations of the form (13) with a weak quasilinearity 
for the coefficients k = k(x,t), f = f(u) and c = c(x,t), common practice 
involves predictor-corrector schemes of accuracy 0(t 2 + Such a 

scheme for the choice c = k = 1, / = f(u) is available now: 


(40) 


y - y 
0,5 r 


= y.«- + /(y)> y = y( t j+i/2), 


-—- = \ {y.v.v + wJ + f(y ). 

r z 


whose composition is depicted in Figure 1, 


y 

y 

y 


-e 

) - { 

H---—* 

>-e 

i- 







i ^i a-h+i 


T + i 

t 3 + i/2 




Figure 1. 

We omit here theoretical investigations of the preceding schemes re¬ 
lying on cumbersome calculations and leading to unsatisfactory and rough 
estimates that can result in wrong reasoning. Such difficulties are, gener¬ 
ally speaking, typical for nonlinear problems in many branches of science, 
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engineering and technology. In tackling nonlinear problems some prelim¬ 
inary tests may be of help in verifying the quality of numerical methods. 
The traditional way of covering this is to compare numerical solutions of 
a simple specimen problem with known analytical solutions of the same 
problem. 

It is worth noting here that Newton’s method is quite applicable for 
solving problem (35) in addition to the well-established method of itera¬ 
tions. 

6. Calculations of the temperature waves. Of special interest is the case 
where the coefficient k(u) is a function of temperature such that 

du _ d / a du \ 

dt dx \ 0 dx J 

As we have mentioned above, the process of heat conducting emerged in 
that case with a finite velocity and the derivative du/dx tends to oo behind 
the front for <x > 1. 

The temperature waves can be found through the use of the scheme b) 
relating to “continuous through execution” ones. No fixation of the front 
applies here. Under the guidelines of the preceding section with regard 
to problem (15)—(17) having the exact solution given by formula (18), the 
calculations permit us to discover that almost everywhere except several 
near-front nodes the approximate solution deviates very slightly from the 
exact one, not exceeding 0.002 for x 0 = 0.5, <x = 2, D = 5 and the total 
number of nodal points N = 50. In so doing the number of the necessary 
iterations is no greater than 3 and t < 0.2. When the temperature wave is 
moving from the left to the right along the zero temperature background, 
more and more grid intervals are captured in a step-by-step fashion in the 
process of numerical solutions in a number of different ways ill connection 
with possible computations of the coefficient a,(i/). 

Apparently, the main idea behind this approach needs certain clari¬ 
fication. For example, formula (38) necessitates imposing a nonzero back¬ 
ground temperature prior to the front. In spite of this fact, there are some 
delays in introducing new intervals, thus causing large deviations of a solu¬ 
tion in a vicinity of the front. Formula (37) is useless for very large values of 
the index a (<x > 20). Formula (36) has the best accuracy and reproduces 
rather accurately without concern of the background temperature. 

7. The Stephan problem (problem of the phase transition). Subsequent 
considerations include two phases with the coefficients of heat conductiv¬ 
ity k 1 (u), k 2 (u) and of heat capacity c^m), c 2 (u), in either of which it is 
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supposed that the temperature satisfies the equation 



At the same time, on the boundary of these phases the temperature is con¬ 
stant and coincides with the temperature of the phase transition: u(x,t ) = 
u*. The velocity of the boundary £ of the phase transition is subject to the 
equation 


du 
kl d.x 


£+0 


du 

~ k2 d.x 




dt 


if u < u* in the first phase and u > u* in the second one. 

With the boundary condition for the phase transition in view, we 
rewrite equation (42) by means of the 6-function as 




c{u) = 


Cj (m) , u < u‘ 


k{u) — 


k l (u) , u < u* , 


( c 2 {u) , u > u* , ( k 2 (u ) , u > u* . 

The method of smoothing is available for solving the Stephan problem. 
As a matter of experience, this amounts to replacing the 6-function by a 
nonzero 6-type function 8(u — u *, A), not equal to zero only on the interval 
(m* — A, U* + A) and must satisfy the normalization condition 


u* + A 


u*- A 


8(u — m* , A) du = 1 . 


The quasilinear equation 



d 

dx 



arises in the process of smoothing the functions fcj ( u), k 2 {u ), c 1 (u) and c 2 ( - u) 
on the interval (u* — A, u* + A). All the schemes we have mentioned above 
find a wide range of applications for its numerical solution. However, there 
are other numerical methods for solving the Stephan problem concerned. 
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8.2 CONSERVATIVE DIFFERENCE SCHEMES 
OF NONSTATIONARY GAS DYNAMICS 

1. One-dimensional equations of nonstationary gas dynamics in Lagrangian 
variables. Plenty of problems arising in mechanics and physics such as 
the harnessing of nuclear energy, the creation of nuclear reactors, aircraft 
(planes and space-vehicles) design, the dynamics of space flights, plasma 
physics (governed thermo-nuclear synthesis) led to equations of gas dy¬ 
namics that are, generally speaking, nonlinear and can be solved by the 
universal difference methods. 

In spite of the fact that problems in gas dynamics began to spread 
to more and more branches of science, engineering and technology as they 
gradually took on an important place in real-life situations, for the time 
being there are no rigorous mathematical results regarding convergence of 
schemes even in the simplest and typical situations. The desirable qual¬ 
ity of schemes are verified with the aid of linear models in the acoustic 
approximation by applying numerical tests for specimen problems, whose 
analytical solutions are known to the users in explicit form. 

As a rule, equations of gas dynamics are discontinuous. From a phys¬ 
ical point of view it is fairly common to distinguish weak discontinuities 
relating to “cutting waves” and strong discontinuities relating to “shock 
waves”. For these reasons successive grid refinement can be made with 
caution when the accurate account of accuracy of numerical methods is 
performed. 

In this section we initiate the design of difference methods for nu¬ 
merical solutions of the simplest problems in gas dynamics. Of our initial 
concern is the problem about one-dimensional nonstationary gas flow in a 
plane with the following ingredients: velocity v, density p, temperature T, 
pressure p, internal energy e. 

In preparation for this, the equations of gas dynamics will reproduce 
the conservation laws of impuls, mass and energy that can be written in 
a number of different ways with respect to Eulerian (x,t) or Lagrangian 
(s,t) variables, where x is the coordinate of a particle and s is the initial 
coordinate of a particle or the quantity 




p(L OK, 


that is, the value of mass in the volume 0 < £ < x. The usual practice 



526 


Difference Methods for Solving Nonlinear Equations 


involves the system of gas dynamics equations in Lagrangian variables (s, t)\ 


( 1 ) 

( 2 ) 

( 3 ) 


dv 

dt 


dp 

ds 


(the law of the impuls conservation), 


dx 

dt 


- v , 


1 dx 
p ds 


(the law of the mass conservation). 




diu 

ds 


(the law of the energy conservation), 


( 5 ) 


P = p(p, T) , £ = e(p,T) (the state equation), 


where w is the heat flow. 

A combination of the second and third equations we have mentioned 
above gives 


( 6 ) 


d /1 \ _ dv 
dt\p) ds 


by observing that equation (2) can be excluded from the governing system 
through the possible separate integration. 

The expression for the heat flow 


(7) w = —x(p, T) p — , 

where x = x(p, T) is a coefficient of heat conductivity, is intended to com¬ 
plete the above system of equations. It should be noted here that x can 
usually be expressed through the power function of T and p. 

The functions p>(p,T), e(p,T), x(p,T ) for this system of equations 
must be given. 

For example, the state equations of the ideal gas are of the form p = 
RpT and e = s(T). The readers can encounter £ = c 0 T, where R and c 0 
are constants, R/c 0 = j — 1, j is constant, so that 

(8) s = p/((y-l)p) . 

In this context, two limiting cases of interest are as follows: 
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a) The adiabatic flow of the ideal gas when w = 0, that is, x = 0. 
Because of this, equations of gas dynamics (1), (6), (4) for the adia¬ 
batic flow of the ideal gas can be represented by 


0) 

dv 

dp 

d 

/1\ dv 

dt 

~Ys’ 

dt 

v p ) ds 

(10) 

d 

( v ' 2 \ 


9 

dt 

her) 

ZZ — 

S~e {PV ' 1 ’ 


which will be put together with equation (8) 


( 11 ) 


P 

(Y - i )p' 


Thus, the resultant system of equations comprises 1 equations with respect 
to four unknowns v, p, p and e. 

We will use below the volume p = 1/p instead of density p. In such a 
setting the preceding equations can be represented by 

dp dv 


(13) 


pv = h - i)^ • 


Equation (10) capable of describing the tootal energy can be replaced by 
one of the newly formed equations 


(14) 


de dv 

~di = ~ P !h 


(15) 


de di] 

dt P dt 


Indeed, taking into account the first equation (9) and (12), we obtain 


„ dp v 

°-Ft( £ + T 


d_ 



dv 

dt 


dp 

!h 



de dv de dp 

= m +p d7s = m +p di- 


b) The isotermic flow of the ideal gas when the temperature of gas 
T = const and the equation of energy is missing. The condition T = const 
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corresponds to the case when x —> oo. The system of equations of gas 
dynamics for the isotermic flow of the ideal gas comprises the equations 


(16) 


dv dp d /I \ dv 

dt ds ’ dt v p) ds 


p = c 2 p, 


where c = const > 0 is the velocity of sound, or 


(17) 


dv dp di] dv 

dt ds ’ dt ds 


which are consistent with the adiabatic case indicated above. In the sequel 
our exposition is mostly based on more a detailed exploration of three 
equations (9), (10) and (11) capable of describing the gas dynamics. 

The complete posing of this necessitates specifying the boundary and 
initial conditions in addition to equations (9)-(10). Knowing 


(18) 


•!>(a:,0), p(x, 0), p(x, 0), 


we may attempt, for example, the boundary conditions in the form 


(19) 

P(M) = Po(0 for s = 0, 

p(M,t) =Pj(t) for 

or 

(19') 

O 

ii 

cO 

>2 

o 

n 

o' 

ii 


Summarizing, it is required to construct difference schemes for equa¬ 
tions of gas dynamics (9)—(10) in the complex closed domain {0 < s < M, 
t > 0}. 

2. Equations with psevdoviscosity. In practical implementations there is 
a real need for forming homogeneous and conservative difference equations 
of gas dynamics. The meaning of homogeneity here is that difference equa¬ 
tions are written at- all the nodes of the grid in just the same way regardless 
of the possible continuity or discontinuity of a solution so that subsequent 
calculations should be carried out by the same ensuing formulas. Homoge¬ 
neous schemes or “through execution” schemes of gas dynamics contain the 
extra members with psevdoviscosity, a key role of which is to spread the 
front of shock waves over several intervals of the grid. From a formal point 
of view, the viscosity lo arises as the additional member to the pressure p, 
so that equations (9)—(10) contain for now instead of p the sum 
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where the “viscous” pressure to = Lo(p,v' s ,h) depends on p, v' and the step 
h. The reader can encounter two types of viscosity: 
a) a linear viscosity 


( 20 ) 


to = 


// 0 h p ( dv 

2 \ k 


dv 

ds 


b) a quadratic viscosity or Neuman’s viscosity 


( 21 ) 


LO 



dv 

ds 


dv 

ds 


dv 

k 


where v 0 is the coefficient of viscosity. It follows from the foregoing that 
the function ui = 0 for dv/ds > 0 and ui yf 0 for dv/ds < 0, that is, only 
within the zone of the shock wave. 

Thus, the psevdoviscosity may emerge only within the zone of the 
shock wave. The accepted view is to use 

v dv 

LO — 

T] ds 
or 

v (dv\ 2 
u = p ’ 

assuming that the coefficient of viscosity depends on the sign of the partial 
derivative dv/ds, so that // = 0 for dv/ds > 0. 

3. Conservative homogeneous schemes. The presence of psevdoviscosity 
makes it possible to design homogeneous difference schemes or “through ex¬ 
ecution” ones, permitting us to reveal the gas distribution caused by shock 
waves. Since the equations of gas dynamics express the conservation laws 
of impulse, mass and energy, the scientists wish to have at their disposal 
conservative difference schemes for which the difference equations involved 
reproduce the analogs of these conservation laws on the grid. 

Equations of gas dynamics in integral form are aimed at designing con¬ 
servative difference schemes by means of the integro-interpolation method: 


( 22 ) 


(v ds — p dt) = 0 , 


(23) 


® (p ds + v dt) = 0 , 



— pv dt) = 0 , 


(24) 
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where integration is accomplished along a closed curve in the plane (s,t). 
To make our exposition more transparent, we introduce the grids 

ui h = {s i = ih , i — 0,1,. .. , iV , hN = M} , 

- {tj = i T , .7 = 0,1,..., j 0 , j : r = t 0 } , 
r ^ do r ) 

retaining the notations -u, rj, p, e with respect to difference equations and 
regarding tile function v to integer points s = s f - on the grid ui h and p, i], £ 
- to half-integer points s = s i+1 / 2 on the same grid. 

Other ideas are connected with setting equation (22) in the rectangle 

{ s »-i/2 £ S £ S J +1/2) tj £ t £ tj + 1) : 

S i + 1/2 tj+1 

J (v 3 + l — v 3 )ds + J (p j + l / 2 -Pi^i/^dt = 0 

s i- 1/2 *j 

and writing equations (23)-(24) in another rectangle {s,- < s < s i+i , tj < 

+ 1 }: 

s i + l i j +1 

j (ri 3 + l - r] 3 )ds - J (v i+l -Vi)dt = 0, 

s i ij 

h'+l tj +1 

j [(£ + 0.5u 2 £ + 1 -(e + O.bv 2 ) 3 ] ds+ j \{[pv) i+l -{pv) i )}dt = 0. 

S J tj 

The integrals built into these identities are replaced by the newly formed 
expressions 


7+1 

tj +1 

tj +1 

J pdt & , 

J V dt , 

J (p y )idt = p ( p } v[ ai) T 

l 3 

l 3 

u 


/Ool — a a f 3 + l + (1 — cr a )f 3 , cr a is arbitrary parameter , 
P*i = 0.5 (Pi- 1/2 + Pi+ 1 / 2 ). a = 1,2, 3,4, 


where 
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and 


* + 1/2 7 + 1 

J J . etc. 

A-1/2 H 

As a final result we get the difference scheme 


(25) 


7+1 j 
v: — v:- 


Pi+L/2 ~ Pi- 1/2 \ t CTl 1 


= 0 . 


(26) 


^+ 1/2 ~ ^+ 1/2 _ fVj + i - 


(27) 


v i+ v hi 


3 +1 


'* + 1/2 f 4 


-* + 1 / 2 + 4 


v 2 + v 2 \n 

l 1 ?+l I 


(<7j) _ (<73.) (<74 ) 

P*i+L 7 + 1 P*i V i 


which falls within the category of conservative schemes for any admissible 
values of parameters oy , <x 2 , <x 3 , <x 4 . In particular, for oq = 0, <x 2 = 1, cr 3 = 1, 
<x 4 = 1 we constitute a system of difference equations, whose solution is 
found successively by the explicit formulas: at the first stage - t^ +1 , at the 
second stage - Vi+ 1/2 an< ^ the third stage - Pj+ 1 / 2 > * = 0,1,... , N — 1 by 
the elimination method from the energy equation and the state equation 
pi] = (7 — \)e being supplemented with the suitably chosen boundary 
conditions for i = 0 and i = N — 1. For example, we might agree to impose 
conditions (19). 

In this context, it should be noted that conservative difference schemes 
may be good enough for the equation of the total energy, but approximate 
poorly the equation of the internal energy (14) 

de dv 


This can result in improper choices of computational procedures in 
giving the temperature. The lack of energetic balances cannot be avoided 
by refining the grid in a spatial variable s. A presence of energetic disbal¬ 
ances in a scheme can be interpreted as a presence of energetic sources of a 
purely difference nature connected with some “lack of agreement” between 
separate difference equations of a scheme being inconsistent each to other. 
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The emerging disbalances are characterized by a typical solution with a 
wide range of values. For example, they are sufficiently small on smooth 
functions, but could grow on solutions varying fastly in time and space 
prior to the total energy of the system concerned. 

4. Fully conservative schemes. Other ideas are connected with successive 
use of conservation laws and more detailed balances of the kinetic and 
internal energy. 

All the schemes with these properties are called fully conservative 
schemes. As a matter of fact, the requirement of the full conservatism 
is equivalent to being approximated of both equations (14) and (15) in 
addition to the usual requirements of approximation: 

de _ dv de _ dp 

dt ^ ds dt P dt ' 

Before going further, it will be sensible to introduce more compact 
notations 


Pi = Pi+ 1/2 > Vi = Vi+ 1/2 . = £i+ 1/2 > P = Pi, ’v-v\, etc, 

^ {Pi + 1/2 ~ ih'-i/l') — Pi ) — v s ■ 

Where there is no danger of confusion, we will omit the symbol “bar” over 
p, r/, £. Within these notations, equations (25)—(26) can be reduced to 

(28) v t = -pi ai \ rit = v ( f 2) . 

Instead of (27), let us consider the scheme generating an approxima¬ 
tion to equation (14) capable of describing the law of the internal energy 

(29) e t = -pi' 73 )?/' 74 ) . 

In this connection .there arises a four-parameter family of schemes, from 
which a fully conservative scheme needs to be selected through the approx¬ 
imations to equations (15) and (10) by appeal to scheme (28)—(29). 

We will use the obvious relationship 

(30) = fW + T(,8-a)f tl 

where a and (] are arbitrary numbers and — af + (1 — a)f. The 

quantity of interest e t can be discovered from 

£ t = -p(°d nt + Sj^E, 8 X E = —t (<r 4 - cr 2 )p (<73) v st , 


( 31 ) 
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which, in turn, can be obtained from the equations rj t = v^ 2 ^ and i/' 74 ) = 
v {° 2 ) — t(<t 4 — cr 2 ) v st = i] t + r(<r 4 — cr 2 )v st . From here it seems clear that 

(31) is consistent with equation (15) only for <x 4 = <x 2 . 

At the next stage scheme (28)—(29) is obliged to be conservative. This 
can always be done by multiplying the equation v t = — pb 71 * by v(°' 5 > = 
0.5(u + v), adding the resulting equation 

(32) 

to equation (29): 

(33) (e + 0.5 v 2 ) t = 

and rearranging the right-hand side of (33) by means of formula (30) as 

(34) pi' 73 -* fi <74 i + ti( 0 - 5 ) p ( ai ) = (pi" 1 ) + t (cr 3 — cJPi) 

x ( v ( 05 ) + r((r i - 0.5) y s( ) + ?/ 0 ' 5 -*p'J 71 * 

= (r!-,V <0,> ), + «^. 


where 


P ( - 1 , = Pi-i = Pi- 1/2 . 

S 2 E = t (on - oq) v [ ° 5) p t + t (a 4 - 0.5) p (<7 ‘ * v st 

+ T 2 (o- 3 -o- l )(o- i -0.5 )p t v st . 

The outcome of rearranging equation (33) is 

(35) (e + 0.5 v\ = -(p[:‘ 1 ) ) ui°' 5 )) s - S 2 E . 

In the preceding the quantity 6 2 E means the disbalance of the internal 
energy. By equating S 2 E to 0 for any p and v we find that <x 3 = oq and 
<x 4 = 0.5 and, hence, <x 2 = 0.5. 

Thus, under such an approach a one-parameter family of fully conser¬ 
vative schemes is given by 


( 36 ) 
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within which the third equation can be replaced by one of the following 
equations: 

(37) e t = - p (^) Vti 

(38) ( £ + 0.5« 2 ) ( = -(p[: i 1 ) )l ;( o - 5 )) j . 

Observe that instead of the latter equation there seem to be at least two 
alternatives 

(39) ( £ + 0.5u ( 2 +1) ) i = -(p^»^ 5 )) ( , 

(40) (e + (v 2 + u 2 +1) )/4) i = -(p[ ai) v(°' 5 ')) s . 


Equation (39) can be derived from the foregoing by involving equation (32) 
at the (i + l)th node 


(41) 0.5 (v 2 i+l ) t — — 


,(°-5)„Oi) 


w i + l 


Vs 


°- 5 (»? +1) ),= 


-v (05) v (a ^ 

V (+1)P S ■ 


Combination of (38) and (39) gives immediately (40). 

Further comparison of (40) with (27) shows that a new family of fully 
conservative schemes is contained in family (25)-(27) of describing conser¬ 
vative schemes with four parameters as a result of employing the integro- 
interpolation method. 

Another conclusion can be drawn from the preceding that for any cr l 
scheme (36) generates an approximation of 0(t + h 2 ) and for cr 1 = 0.5 it 
provides an approximation of 0(t 2 + h 2 ), that is, only one scheme of the 
form (36) can guarantee a second-order approximation in r: 


(42) 


v t = -p 


(0.5) 

S 


Vt = v 


(0 5) 

5 


_ p C,5) 




With the psevdoviscosity in view, we replace everywhere in formulas 
(36) the pressure p by the approved rule g = p + ui, leaving us with 

(43) v t =-g ( p\ i li = v ( s °' 5 \ £* =-0 (<7l M°- 5) , g = p + u>. 

For the ideal gas and the linear viscosity, this amounts to 

(44) PV=( 7~l)e, L0 = ~7 1 Vs ‘ 
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Putting these together with the supplementary boundary conditions for 
i = 0 and i — N, say with the values p> 0 , p s N of pressure, we must write 
down the equation of the motion for v\ not only at the inner nodes, but 
also on the boundary for * = 0 and i — N\ 

v3 o +1 ~ v3 o _ / Pi/2 - Po \( ai) — v 3 ^ _ / P N ~PN-i/2 \( ai) 

t V 0.5 h ) ’ t \ 0.5 h / 

giving v 3 0 +1 and 1 . The remaining quantities rj, e, p are sought only at 
the inner half-integer points s 1/2 , s 3j , 2 ,..., s N _ 1 j 2 . 

It seems worthwhile giving one possible example of nonconservative 
schemes. A “cross” scheme was very popular and much applicable in recent 
decades. Any scheme of this structure can be written on a “chess” grid by 
regarding £, p, i] to half-integer nodes (s i+1 p,t- + l j 2 ) an d v > x t° integer 
nodes of the grid at hand. 

Within the notations pj+ 1/2 = pj = P and = rfi +L = 3 ~h etc., 

the “cross” scheme 


J + i 


p: 


.J + i/2 _ 3+1 /2 
* + 1/2 Pi- 1/2 


3+3/2 _ j-l/2 
"i +1/2 ’H +1/2 


v 3+l 
V i +1 


3 + 1 
V; 


J+3/2 _ 3+ 1/2 
* + 1/2 t *+l/2 _ J+3/2 

T ~ P i + ll2 


.,3+1 
V i +1 


J + l 


h 


admits an alternative form 


(45) v t = -p s , V t = v s , £ t = -pv s , 

showing the new members to be sensible ones. In this line the values on 
every new layer is found by the explicit formulas. No wishing to load the 
book down with full details on this point, we cite only a final result after 
multiplying v t = — py by r/ 0 ' 5 ) and repeating the preceding manipulations 
in such a setting: 


(e + 0.5 c 2 ) 4 = — u (0 5, ) s — 6 E , 

where SE = Tp t v^ > 5 '> + 0.5 rpv st + 0.5 T 2 p t v st , that is, scheme (45) is not 
conservative, thus causing .some limitations in practical implementations. 
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5. Numerical solution of difference equations by Newton’s method. As 

can readily be observed, the system of nonlinear equations capable of spec¬ 
ifying the values v 3+1 , g 3 + l and rj 3+1 on every new layer will be solved 
by making several iterations of Newton’s method. This can be done by 
reducing equations (43)—(44) to the following ones: 

v + <?i T 3s =v - (l- oq) t g s , 

fj — 0.5 tv s = rj + 0.5 tv s , 

£ + °i9 (V - V) + (1 - °h) 9 V = £ + (1 - °h) 91 > 
g fj — i { 7 — 1) + // v s = 0 , 


After that, applying Newton’s method yields 



A k t X +a 1 rA k ^ : 

k 

= h - 

(46) 

A ^ 1 - 0.5 rA 1 ,) 1 

k 

= / 2 . 

(47) 

A k t L +9 iai) A k V L 

, k , k + i ^ 

+ <M*7 - 7]) A g - / 3 

(48) 

a At —|— 1 k*A;+l \ k-\-l 

— As + a g A i] + a g A cj + a v A v s 


k = 0 , 1 , 2 ,... , 


where 




a = l/( 7 - 1) , 

l = 1 = 0 for k > 0 , 

° ° n s 0 

f l = v ~ v - (1 - oq) rg s - oqr g . , 

0 0 Os 

/ 2 =V~V +0.5r(u s + v s ), 
f 3 = ~£ +£ -9 {ai) {rj - V) > 

9 (ai) = <rj + (1 - <Ti)g , 
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h k k k k 

/ 4 = £ - ag rj - av v$ , 


a k + 1 k + 1 k 
lA V — V — V 


. & 1 A? —|— 1 k 

At) ~ r] — 7) , etc. 


During the course of the elimination of , A rj and A^J 1 from 

the foregoing we obtain the three-point difference equation for determina- 
, • « k +1 * ^ + 1 

tion ot y — A g 


(^1 (v 


rj) + a rj ) k y 1 - a 1 t ((g (<Jl} + a g ) 0.5 r + a v) 


k + l 


k 

F 


k k k k k 

where p is expressed in terms of / f 2 , f 3 and f 

method can be employed for the last equation, permitting one to find, 

A k + 1 A k+l API in f A k+1 k+1 

A rj , A e with knowledge ot A g — y 


first. 


A ^' + 1 

A v . 


The elimination 


and, second, 


k + 1 
9 


A k + ^ 

A g 


k + L 
V 


A ^ + 1 
A v 


etc. 


6. Convergence of Newton’s method. We are now in a position to find out 
the conditions under which Newton’s method converges. With this aim, 
the differences 


_ ifc + i k + l .k + 1 A + l 

t> 9 = 9 ~ 9, 6 i] = i] -rj, 


C t‘ + l 
0 V 


k + l 
V 


where g, Tj and v are the exact, solutions to equations (43), will be given 
special investigation. For this, we write down a typical equation related 
to such a difference. By the linearity of equations (46) the homogeneous 
equations 

(49) 8 k V = -<T 1 r8 k ^ , 6^=0, k = 0,1,2,..., 

follow immediately from the foregoing. Putting equations (47)-(48) to¬ 
gether with the newly formed differences 


c ^‘ + 1 
0 £ 

-6e , 

<1 

c * + 1 
-0 7] 

— 8r] 

c A' + l 

0 V 

-5v , 

. k + i 

A g - 

c k-\-l 
= & 9 

-Sg 
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one succeeds in showing that equation (47) becomes 
b k t 1 + g ( ' ai) 6 k r] 1 + a 1 (?) - 77 ) <5 k g 1 = F 3 , 

F 3 = g (ai Hri + 5 k + a^rj -rj)8g 

- [Se + (£ - e) + (o-^Sg + (8 % + fj - rj)] 

= 0h(»7 -r))8g 8 g - [(£ - e) + g (ai \fi - rj)} 

- a^ri 8g , 

since t — e + g (ai) (ri - v) = 0 on account of (43). Because of this, we thus 
have 

(50) 8 k £ l + g {l7,) 8 rj + cr l [rj — ?/) 8 g = <r l 8 r) 8 g . 

An alternative form of equation (48) is 

(51) —o £ + a</6 i) +ar]8 g + av8 v s =ci8ij8g. 

Indeed, from (48) it follows that 

0 = -(<5 fc £ 1 - <51) + a g (8 k rj i - 8rj) + arj (8 k g L - 8g) 


'(8 


k +1 


c k 
0 V„ 


)~(8l+i 


k k 
ag r] 


k 

av v. 


r ck+1 k c fc +l k c *+! i rfc+ln * 

= [-0 £ +ag 8 T] + ar) 8 g + av 8 v s \ ~ F A , 

where 

k k k k k k , kk k 

F 4 = ag 8 r]+ar] 8 g + a v 8 v + c — arj g — a v v s ■ 

Substituting here £ = agrj + avv $ yields F 4 ^ a 8 ij 8 g . 

Having completed the elimination of 8 k £ L from (50) and (51) both, 
we arrive at 

(52) (ag +g^ l) ) 8 l 't/ + ((a + ajrj - 0^)8 k g l + av 8 k y 3 

= (a + a 1 ) 8 r j 8 g . 
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By inserting now <5 V/ = —cr^S k g} $ and 6 'rj — 0.5r<5 V/ we deduce 
with regard to 


k k \ k 

a k = (r,r[av + 0,5r(as + g t<71 ')] / [(a + oy) rj - 0 ^ 77 ] >0 


that 


(53) S L g L - a k 6 ^ = q k Sg , 9k 


(a + a^Srj 

k 

(a + cj rj -o-i?? 


provided the condition (a + ay) r] — cr a 77 > 0 holds. The meaning of this is 
that 


(54) 


rj > ——— ?? for all fc = 0 , 1 , 2 ,. .. 
a + cr 1 


was supposed before proceeding to further derivations. 

When the pressure is prescribed for i = 0 and i — N, the boundary 
& + 1 

conditions for 6 g are certainly homogeneous; 


(55) 5^o=0, 6%= 0. 

After scrutinising the canonical form of equation (53) with respect to 
6 9 (* ,;) 

A(P)y(P)= Y B(P,Q)y(Q) + F(P) 

Qeiii'(P) 

we can be pretty sure that 


A(P)> 0, B(P,Q)> 0, D(P) = A(P) — Y B(P,Q)=1. 

Qeiir(P) 

This serves to motivate the validity of the maximum principle with regard 
to equation (58) supplied by the homogeneous boundary conditions (55). 
By utilizing this fact it is plain to show that the estimate holds: 


(56) W^VWc < \q k \ ll^llc- 

whence it follows that the iterations converge under either of the following 
conditions: 


( \ ( lk\ A q < l for all k = 0 , 1 , 2 , . . . 


Id - f)\ 

k > 
v rj — bi] 


<q, b 


a + <Tj 


( 57 ) 
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The preceding is equivalent to the inequalities 


(58) 


n + b q i] k r> — b q ri 

\ ^ -— 

1 + q 1 -q 


V> bqr), 


thus causing, in fact, some restrictions on the step in time in connection 
with the dependence upon the variations of volume i] (or density p = 1 /rf). 

o 

By setting k = 0 and choosing rj = rj we obtain 


1 

V 


I V - v\ < ?(! - b ) 


or, what amounts to the same, 


(59) (l - q (1 - b)) r] < fj < (l + q (1 - b)) i] 


When the isotermic flow of the ideal gas (17) is considered, scheme (43) 
can be written in simplified form, since the energy equation was disappeared 
because T = const . A proper iteration process is governed by the same 
rule as in the adiabatic case, the convergence of which can be established in 
a similar way without difficulties. In the isotermic case with the assigned 
values -y=l,a = oo,6 = 0we deduce instead of (58) that 


n 

i + q 


k 


< rj < 



and 


I ? 7 — ^ I 

i] 


< q- 


Under the first or second condition (57) the following relations occur: 


ll<5 k V || c < q k+1 || c , k Y —>0 as k^oo, 

thereby justifying the convergence rate as a geometric progression for the 
iterations just established. 

Numerical calculations for j = 5/3 (a = 1.5) showed that the itera¬ 
tions within the framework of Newton’s method converge even if the steps 
t are so large that the shock wave runs over two-three intervals of the 
grid ui h in one step r. Of course, such a large step is impossible from a 
computational point of view in connection with accuracy losses. Thus, the 
restrictions imposed on the step r are stipulated by the desired accuracy 
rather than by convergence of iterations. 
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7. Equations of gas dynamics with heat conductivity. We are now inter¬ 
ested in a complex problem in which the gas flow is moving under the heat 
conduction condition. In conformity with (l)-(7), the system of differential 
equations for the ideal gas in Lagrangian variables acquires the form 


dv 

dg 

di] 

dv 

de 

dv 

dw 

dt = ' 

ds ’ 

dt 

= aJ ’ 

dt 

= ~ 9 lh 

ds 


= RT, 




( dv 

\ 

pi] - 

<r - 
<— - 

= CyT , 

LO = 


'*')■ 


dT 


-x(p, T)~— is the heat flow and g = p + lo. 
os 


where w 

U -5 

It is plain to create for this system of equations a fully conservative 
scheme such as 


(60) 


v t 

= ^ = 

: l/°' 5 ) , 



G 

= -g(ct) V (0.S) _ 

- w W , 

5 5 



w 

= —k Tj , g = 

P + u , 

LO - 

= ^(tgw), 

P 

— RT/r ], £ = 

: C yT , 



■ X 

(0.5 (?7,-~o.s + n. 

j + 0.5 )) 0 

5(7), 

-0.5 + 7,; + y 5 )) 


where k = k i 
and (3 > 0 are arbitrary numbers. 

Generally speaking, Newton’s method may be employed for nonlinear 
difference equations on every new layer, but the algorithm of the matrix 
elimination for a system of two three-point equations (see Chapter 10, Sec¬ 
tion 1) suits us perfectly for this exceptional case. We will say more about 
this later. 

The main idea behind this approach is to accelerate and simplify the 
algorithms by means of the method of separate or successive eliminations. 
To that end, the difference equations (60) are divided into the following 
groups: 

I: “dynamical group” 


7 («) 


dt 


.,(0.5) 


g = p + u, 


p = 


U> - Lo(l], v s ,v) 


P(V,T) ■ 
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II: ; ‘heat group” 


e t = -gW r/°' 5) - wf) , w = —k T s , 

£ -e{r],T), k - x (0.5 (p + />(_!)), 0.5 (T + T ( _ 1} )) . 

After that, Newton’s method of iterations applies equally well to either of 
these groups independently. By analogy with the isotermic case the first 
group of equations is to be solved with a prescribed temperature, while 
the second one needs the assigned values of rj and v. The essence of the 
matter in the last case is that the origin of the heat conduction equation is 
stipulated by the available sources of a dynamical nature. 

The iterations in the first and second groups can be found successively 
by the elimination method. Having completed the kth iteration, for which 
the condition of termination ||a£|| c = ||y — 1 j[ c < e 0 ||*|| c is fulfilled, 

where £ 0 > 0 is a prescribed accuracy, there is no doubt that the values v 
k 

and r] are known. 

k h m 

With knowledge of v and i] the mth iteration T is recovered from the 
equations of the second group by Newton’s method. 

The process of the exterior iterations continues to develop prior to the 
occurrence of the convergence conditions. 

Another way of going further is connected with re-ordering of these 
groups in reverse direction or inserting k = 1 and m — 1 in all of the 
iterations. The separate elimination method may be of assistance in mini¬ 
mizing the total volume of the available information in the storage of high- 
performance computers. 



Economical Difference Schemes 
for Multidimensional Problems 
in Mathematical Physics 


One of the serious developments in computational mathematics owes a debt 
to economical difference methods available for solving partial differential 
equations of several spatial variables. Recent years have seen the publica¬ 
tions of numerous papers on this subject for multiple equations of parabolic, 
hyperbolic and elliptic types as well as the constructions of various eco¬ 
nomical schemes. The general stability theory lies in the foundations of the 
possible theory of economical methods which will be given special investi¬ 
gation throughout the entire chapter. Two classes of admissible economical 
schemes are of great importance: schemes with a factorized operator on the 
upper layer and additive schemes generating a summarized approximation 
in a certain up-agreed sense. These can depend on the range of situations 
to be considered. 


9.1 THE ALTERNATING DIRECTION METHOD 
(THE LONGITUDINAL-TRANSVERSE SCHEME) 

FOR THE HEAT CONDUCTION EQUATION 

1. Some preliminary information on economical schemes. One of the most 
important issues in numerical methods is the well-founded choice of eco¬ 
nomical computational algorithms, the realization of which requires a nr in- 


543 



544 Economical Difference Schemes for Multidimensional Problems 


imal execution time in giving an approximate solution with a prescribed 
accuracy e > 0. The total number of the necessary arithmetic operations 
Q(s) for doing so is the main characteristic of the algorithms in question, 
since other characteristics such as the quality of the related software and 
the availability of advanced-architecture computers are beyond our control. 

In view of this, the economy requirement becomes rather urgent and 
extremely important in numerical solution of multidimensional problems 
arising time and again in mathematical physics. 

To understand the nature of this a little better, we focus our attention 
on the simplest examples serving to motivate what is done with economi¬ 
cal difference schemes and regarding to some preliminaries. The object of 
investigation rs the heat conduction equation in the space R p ; 


d 2 u 


u(x, 0) = u 0 (x ). 

Let G = Gop = {0 < x a < 1, a — 1,2,... ,p} be a cube of the dimension 
p] u> h = {(ij/i, . .. , i p h) G G} be a cubic grid with step h in all directions 
x a , a = 1 , 2 ,... ,p, and u> T be the grid with step r = t 0 /n 0 on the segment 
0 <f < V At the next stage the operator 

d 2 u 

LaU = d.^ 

a 

is approximated by the difference operator A a y = j/ s , so that A = 
YUa-i Aq., leaving us with the weighted two-layer scheme 


U LL ^—r 

( 1 ) — = Lu , Lu = y ' L a u , 

O'— 1 

x G G , t G (0, f 0 ], u| r = 0 , 


y t = A {(TIJ + (1 - a)y) , X G ui h , 0 < t = nr < t 0 , 


( 2 ) 

y\ lh =o, y(x,o) = y 0 {x). 

We recall from Chapter 5, Section 3 that scheme (2) is stable with respect 
to the initial data under the constraint 

1 h 2 

a > -= <x n . 

“ 2 Apr 

By merely setting cr = 0 we have at our disposal the explicit scheme 
(3) y t = Ay or y = y+ r Ay, 
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which is stable for r < 0.5 h 2 /p. If equation (1) contains the variable 
coefficients, that is, it acquires the form 

LaU = 0^“ (*“(*’*) Jr) ’ 

then 

p 

A a u = (a a x , A=£a 0i 0 < a a < c 2 , 

a— 1 

and the explicit scheme (3) is stable for r < 0.5 h 2 /(pc 2 ). 

From here it seems clear that the admissible step in the explicit scheme 
is yet to be refined along with increasing the maximum value of the coef¬ 
ficient of heat conductivity. As a matter of fact, the last requirement is 
unreal for the problems with fastly and widely varying coefficients. Just for 
this reason explicit schemes are of little use not only for multidimensional 
problems, but also for one-dimensional ones (p = 1). On the other hand, 
the explicit schemes offer real advantages that the value y = y n+1 on every 
new layer t n+1 = t n + t is found by the explicit formulas (3) with a finite 
number of operations at every node of the grid ui h , so that the amount 
of arithmetic operations required in passing from one layer to another is 
proportional to the total number of the grid nodes and so it is a quantity 
of 0(l/hP). 

Being concerned with the implicit scheme for <x = 1 , we may set up 
the problem for determination of y n+1 : 

y n+l -TAy n+l =i/ , f/ n+1 | 7h = 0 , y(x, 0 ) = u 0 (x) . 

Numerical solution of this system containing 1 /h? equations requires, for 
example, during the course of Gaussian elimination 0(l//i 3p “ 2 ) operations 
in connection with a special structure of the matrix E — tA. 

Some consensus of opinion is desirable in this matter, since a smaller 
number of operations is performed m the explicit scheme, but it is stable 
only for sufficiently small values of r. In turn, the implicit .scheme being 
absolutely stable requires much more arithmetic operations. 

What schemes are preferable for later use? Is it possible to bring to¬ 
gether the best qualities of both schemes in line with established priorities? 
In other words, the best scheme would be absolutely stable as the implicit 
schemes and schould require in passing from one layer to another exactly Q 
arithmetic operations. As in the case of the explicit schemes, Q would be 
proportional to the total number of the grid nodes so that Q = 0(1/h p ). 
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Bexause of these facts, the number of the necessary operations at every 
node of the grid is independent of the total number of the grid nodes. All 
the schemes with the indicated property are said to be economical. 

In what follows one possible example demonstrates for a system of 
ordinary differential equations that there is an implicit scheme which is 
rather economical than the explicit ones requiring the additional operations. 

Example With this aim, it seems worthwhile giving the following system 
of differential equations: 

du 

— +Au = 0, f>0, u(0) = u 0 , 

where u = , u^ m \t)) is a vector of order m and A = (a^) is a 

symmetric positive definite matrix. In passing from one layer to another the 
explicit scheme y n+i = y n — rAy n requires 2m 2 + 2m arithmetic operations. 

Furthermore, let A~ = (cm) and A + = (a+) be an upper and a lower 
tridiagonal matrices with coinciding main diagonals cm = cA = 0.5 a u . 
Both matrices (operators) are positive definite in the sense of the usual 
inner product in the space R ,n , since A = (A + )* and 

(Ax, x) = (A + x, x) + ((A" 1 ")*!’, x) = 2 (A + x, x) = 2( A~ x, x) . 

Before going further, we initiate the construction of the scheme 

(4) P2n+1 ~ y2n + A~y 2n+1 + A+y 2n = 0 , 

(5) V2n+2V2U+1 + A .- + A+y 2n+2 = 0 , 71 = 0,1,..., 

T 

in which it is necessary to perform the inversion of both tridiagonal matrices 
(E + tA~ ) and (E + tA + ) in determining y 2n+1 and y- 2n + 2 - 

It is plain to show that the scheme in view is absolutely stable for any 
t > 0, permitting one to eliminate y 2n +i from the difference equations (4) 
and (5). By subtracting equation (5) from equation (4) we find that 

2 U2n + 1 = V'2n + V'2n + 2 + T A + (y 2n + 2 ~~ V2n) ■ 

Upon substituting the resulting expression into (5) we obtain through such 
an analysis the scheme 

B V2n + 2 -y2n + A y 2n=zQj 

2 r 


( 6 ) 


A = A~ + A+ , 
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where the operator B = (E+tA~ )(E+tA + ) is a product of two self-adjoint 
“triangle” operators, since A + — (A~)*. 

Observe here that the factorized operator B also is self-adjoint. By 
means of these operators a sufficient condition of stability becomes 

B — 0.5 (2 r A) = E -\- tA + t 2 A~ A + — t A > E 

in light of the relations (A~ A + x, x) = ||/l + ;r || 2 > 0 and A~ A + > 0. This 
supports the view that scheme ( 6 ) is absolutely stable and it is of second- 
order accuracy. 

Let A± be new tridiagonal matrices differing from A± solely by the 
zero elements on the main diagonals. While solving equation (4) and equa¬ 
tion (5) we should save in the storage the vectors A~ y 2n+l and A + y 2n+2t 
respectively. All this enables us to evaluate the number Q\ relating to the 
necessary operations in passing from the layer t 2n to the layer t 2n+2 . For 
scheme (4)—(5) we have Q\ = 2m 2 + 12m, while for the explicit scheme - 
Q o = 4m 2 + 4m, that is, Q\ < Q o for m > 4. 

2. An alternating direction scheme. Further developments are concerned 
with the heat conduction equation of two independent variables that can 
serve as test vehicles for the difference schemes to be presented: 


(7) 


du 

dt 


Lu+ f(x,t ), x G G 02 


t G ( 0 , t 0 ], 


u\ r = fi(x,t), u(x, 0) — u 0 (x ), 


Lu — Ati = (Li + L'j) u , 


L n u = 


d 2 u 

c)x 2 


a — 1 , 2 . 


Here G 02 = G 0 = {0 < x a < a = 1,2} is the rectangle of sides l l and l 2 
with the boundary F. 

As a first step towards the solution of this problem, it will be sensible 
to introduce an equidistant grid u> h in the direction x a with steps h l = ^/N 1 
and h 2 = l 2 /N 2 and the boundary y h containing all the nodes lying on the 
sides of the rectangle except its vertices, ui h — to h + j h . We will use them 
for later approximation of the operator L a by the difference operator 


A «f/ = y$ aXa - A = Aj. + A 2 . 

Recall that in the case of the one-dimensional heat conduction equation 
a similar implicit scheme is associated on every layer with the difference 
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boundary-value problem of the form 

( 8 ) MVi-v - CiVi + Bry i+1 = -Fi , i = 1,2,. . . , N - 1 , 

Vo = Mi . Vn = A 2 . -4* > 0, Bi > 0 , Ci > Ai + Bi . 

This problem can be solved by the standard elimination method requiring 
0(1/h) = O(N) operations, the amount of which is proportional to the 
total number N of nodal points of the grid u> h = {jq = ih , 0 < i < N}. 

With regard to problem (7) posed in the rectangle, it is worth noting 
several things. The grid ui h at hand may be treated either as a collection 
of the nodes along the rows i 2 = 0 , 1 ,... , AT or as a collection of the 
nodes along the columns ii = 0 , 1 , . . . , Ah, thereby providing for subsequent 
compositions the availability of Ah + 1 nodal points along every row as well 
as At 2 + 1 nodal points along every column. 

In trying to solve a typical problem like (8) by the elimination method 
for fixed i 2 (or q), exactly 0(N\N 2 ) arithmetic operations are needed in 
giving a solution at all the nodes of the grid. Their amount is proportional 
to the total number of the grid nodes in the plane. The main idea behind 
economical methods lies in successive solution of one-dimensional problems 
of the type (8) along rows and along columns in passing from one layer to 
another. 

The scheme ascribed to Peaceman and Rachford provides some 
realization of this idea and refers to implicit alternating direction schemes. 
The present values y = y n and y = y n+1 of this difference scheme are put 
together with the intermediate value y = j/ n+1 ^ 2 , a formal treatment of 
which is the value of y at moment t = t n+] j 2 = + t/ 2. The passage 

from the nth layer to the (n + 1 )th layer can be done in two steps with the 
appropriate spacings 0.5 r: 

n + l/2 n 

(9) J nr U = Aiy n+1 / 2 + A 2 y n + >p n , 

0.5 r 

n + l _ n + 1/2 

(10) --- = A 1 J/ n+ 1 / 2 + A 22/ n+1 +f n . 

U.D T 

These equations are written at all inner nodes x = of the grid to h 
and for all t = t n >0. Let us stress here that the first scheme is implicit 
along the direction x l and it is explicit along the direction x 2 , while the 
second one is explicit in the direction x l and it is implicit in the direction 
x 2 . Equations (9)-(10) are supplemented with the initial conditions 

(11) y(x,0) = U : (x) , x <E u> h , 



The alternating direction method 


549 


and the difference boundary conditions, for example, of the special type 


(12) 

yU + i 

c2 

+ 

ii 

i 2 = 0 and i 2 

= n 2 

(13) 

y " + l/2 

= fj, for 

ij — 0 and 

= n l 

where 





(14) 

1 

fl= 2' 

H +1 + H)~ 

“~a 2 (H +1 ~ 

-H) 


The meaning of the boundary condition (12) is known to us. On the other 
hand, condition (13), which assigns the boundary value ij, needs certain 
clarification. In this way, the difference boundary-value problem (9)-(14) 
can be put in correspondence with problem (7). The method for solving 
this difference problem is mostly based on alternative forms of equations 

OHIO): 


- V - Ai y = F , F = - y + A 2 y + <p , 
r r 

(15) 

2 2 

-y-A 2 y = F, F=-y + A 1 y + ip. 

T T 

To make our exposition more transparent, it is more convenient to introduce 
the new members 


x i = (HtH/H . F = F ili2 , y = y ili2 

and approve the following rule: when one of the subscripts is kept fixed, we 
omit it for a while in relevant expressions. This should cause no confusion 
and guides a. proper choice of alternative forms of equation (15) for later 
use: 


(16) 


1 / 1 1 \ 1 

hf ~ 2 [iF 1 + t) y '1 + “ ~ Fil ’ 

*i = 1,2,... Hr - 1, y=y for T = 0 ,AH 


( 17 ) 


1 

hf ^ 2 " 


- 2 


1 

K 


1 H 1 - 
T J Vi2 F ^2 Vi 2 + i 


-F ia 


h = 1, 2, .. . , N 2 ~ 1, y = ji for i 2 = 0,N 2 . 
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Let a value y = y n be given. Starting from F, we move further 
along the rows i 2 — 1 , 2 ,. .. , — 1 to solve problem (16) by the standard 

elimination method, whose use permits us to determine the values y at all 
the nodes of the grid ui h . After that, we calculate F and move along the 
columns zj. = 1,2,... , A/’i — 1 in an attempt to solve problem (17) and find 
the values y — y n+1 . In passing from the (n+l)th layer to the (n+2)th layer 
the same procedure is workable, thus causing the alternating directions. 

Since the elimination method requires several operations at one node, 
the total number of which is independent of the grid step, the algorithm just 
established will be economical if one succeeds in showing that scheme (9)- 
(14) is absolutely stable. The following sections place a special emphasis 
on stability and convergence of the scheme concerned. 

3. Stability. Subsequent considerations of stability of scheme (9)—(14) are 
conducted with a priori elimination of the intermediate value y. This can 
be done by subtracting equation (10) from equation (9) and re-ordering of 
the relevant one as 

(18) 2 y = y + 3 / — 0.5 r A 2 (y — y) , x£ui h , 

Substituting (18) into (9) yields 

(19) ^^ A o(y - y) - i Ai(t/ + y) - - Ai A 2 (j/ - y) + A 2 y + y?. 

t 2 2 4 

With the relation y — y + ry t in view, the intention is to use (19) in the 
canonical form 

(20) (E - 0.5 t Aj) (E - 0.5 r A 2 ) y t = Ay + <p . 

Under such an approach formula (18) should also be valid for x l = 0 and 
x x — /j, since otherwise (Apf/),- refers to the undetermined values for = 1 
and = Ni — 1. Knowing y = y and y = y for = 0 and aq = l lt we 
deduce from (18) that 

1 t 2 

y = — (y + y ) —— A 2 /r i = y for x x — 0 and x x = /j , 

by observing that these coincide with the boundary conditions (13)-(14). 
Thus, we have proved that a solution of problem (9)—(14) satisfies equation 
( 20 ) subject to the supplementary conditions 

y\ = 

J Hh 


( 21 ) 


h. y l 7 k =/i, y(x,0) = u 0 (x). 
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On the other hand, a solution of problem (20)—(21) applies equally well to 
problem (9)—(14). Indeed, by specifying y by formula (18) we deduce from 
(18) that 

(E — 0.5 r A 2 ) y — 2 y — (E + 0.b t A 2 ) y 

and insert then the resulting expression in (20). By minor changes we are 
led to equation (9), which in combination with (18) gives (10). This pro¬ 
vides enough reason to establish the equivalence between problem (9)—(14) 
and problem ( 20 )—( 21 ) with compliance of the boundary values y assigned 
by formulas (13)—(14). Careful analysis of scheme (9)—(14) is accompanied 
by more a detailed exploration of scheme ( 20 )—( 21 ) in “integer steps”. 

The general theory of two-layer schemes is quite applicable in such a 
setting. By regarding the boundary conditions to be homogeneous we turn 
to the problem 


(22) (£■ — 0.5rA 1 )(£'-0.5rA 2 )y ( = Ay + >p, t> 0, 

y(x,0) = u 0 (x) , y| 7 k = 0 , 

with further reference to the space H of all grid functions given on the set 
Co h and vanishing on the boundary ■y h under the inner product structure 

AP-i ATs-i 

(y, v) = y(x) v(x) h l h 2 = y(i 1 h 1 ,i 2 h 2 )v(i 1 h 1 ,i 2 h 2 ) h 1 h 2 , 

i 1 = 1 *2 = 1 

The associated norm is taken, as usual, to be || y || = \/(y, !/)■ We refer 
to the operator A — —A — —(Ai + A 2 ), which, by definition, is self-adjoint 
and positive in the space H, The norm on the energetic space Ha is defined 
either by 

ATi n 2 -l n 1 -l n 2 

iiyii^i — y y y y {y&i (®i>*2^2)) y ] y ] {yx 2 (A^ nby) ^2 

fjZil *1 —1 *2 —1 

or by 

(23) 112/11“ =HfeJli + li%Jl2- 

When treating y = y(t) as an abstract function of the argument t £ ui T 
with the values in the space H , scheme ( 22 ) admits an alternative form 

(24) B y t + Ay — <p{t) , 0 < t - nr < t 0 , y(0) = u 0 , 
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where B = (E + 0.5 t Ay) (E — 0.5 r A 2 ), A a = -~A a , A = Ay + A 2 . 

Because of the rectangular form of the initial domain, the operators 
Ai and A 2 are self-adjoint, positive and commutative. It is straightforward 
to verify the relations AyA 2 — A 2 Ay and AyA 2 y — A 2 Ayy = y Sul - lS2X2 at all 
the inner nodes of the grid. In view of this, the strict inequality AyA 2 > 0 
is simple to follow. From the form (24) it seems clear that 

(25) B > E + O.b t , 

thereby clarifying that scheme (24) is stable in the space Ha- Indeed, 

2 

B - 0.5 tA = {E + T -A + T — A v A 2 )~\A 

r 2 

= E+—AyA 2 >E. 

From condition (25) it follows that for scheme (24) Theorem 7 from Chapter 
6 , Section 2 is still valid with e = 1, due to which a solution of problem 
( 22 ) satisfies the inequality 


(26) || y(t + t)\\ a < 112 /( 0 ) 11 ^ + ^ t II tKO 


Also, the a priori estimate holds true: 


(27) II y{t + r )II < l|y(°)ll + yi f Y, 


1/2 


i/2 


To make sure of it, we apply the operator A 1 > 0 to both parts of equation 
(24). The outcome of this 


By t + Ay = <p , A-E , ip = A v ip, 

T t 2 

B ■= A~ l -\ — E -\ - A~ x Ay A 2 . 

2 4 

Since the operators Ay, A 2 and A~ x > 0 are commutative and self-adjoint, 
the relations A~ x AyA 2 > 0 and B > A~ l + 0.5 r E occur. Applying Theo¬ 
rem 10 from Chapter 6 , Section 2 yields estimate (27). 


(28) 
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Theorem 1 Scheme (22) is stable with respect to the initial data and 
the right-hand side. A solution of problem (22) satisfies a priori estimates 
(26)—(27). 

4. Stability and accuracy. By utilizing the fact that scheme (9)—(14) is 
equivalent to scheme ( 20 )—( 21 ) subsequent considerations of convergence 
and accuracy of the first scheme will appear for the second one. Let u = 
u(x,i) be a solution of problem (7) and y = y(x i ,t n ') be a solution of 
problem (9)—(14) and scheme (20)—(21). Upon substituting y = z + u into 
( 20 ) we may set up the problem for the error of this scheme: 


(29) B z t = A z + ip , x G ui h , 0 < t — nr < t : , 

z \-y h = 0 > = 0 , 

where B = (E — 0.5 r Ai) (E — 0.5 r A 2 ) and ip is the error of approximation 
equal to 

(30) ip = ip + A u — B u t = 0.5 A (ii + u) — u t — t 2 Ai A 2 u t + p>. 


From such reasoning it seems clear that 

ip = 0(|/i| 2 + t 2 ) , |h| 2 = h 2 + A 2 , 


under the condition that the solution u = u(x,t) possesses in the region 
Q t — Gq x [0,f o ] the derivatives 


(31) 


d 3 u 

1)E 


< M , 


d 5 u 

dx^ dxp, dt 


< M 



< M , 


d 4 x 

dx 4 


< M. 


The final result is an immediate implication of the asymptotic relations 
0.5 (u + u) zz ii + 0(r 2 ) and u t = u + 0 (t 2 ), where u = u(x,t n + 0.5 r) 
and the quantity A 1 A 2 u is bounded. Since for problem (29) estimate (26) is 
valid for the assigned value z( 0 ) = z 0 — 0 , we might formulate the following 
assertion. 


Theorem 2 Under conditions (31) scheme (20)—(21) converges in the grid 
norm (23) with the rate 0(r J + |h| 2 ). 
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5. A scheme for the governing equation with variable coefficients. The 

intention is to use the alternating direction scheme for the heat conduction 
equation with variable coefficients 


(32) t— L u + / , (x ,t) £ Qt , 

u| r = n(x,t), u(x,0) = u 0 (x) , 

L u = L l u + L 2 u , L a u = (k a (x,t ) , 

ox a \ 0x a / 

k a (x,t) > 0 . 

In such setting, for any t, the operator L a is approximated by the difference 
operator 

A a y = A a (t)y = (a a (x,t)y jlci ) x ^, a =1,2, 

where a Q can be founded either by the formula a a = &b~ 0 ' 5 ") or by the 
formula a a = 0.5 (k a + &0” lc> i), a = 1 , 2 , which guarantee a second-order 
approximation provided by the operator A Q : 

A a u - L a u = 0(h 2 a ) . 

Instead of (9)-(10) we are trying to adopt another scheme 


(33) l ^j^ = A 1 (i)y + A 2 (t n )y n +v\ 

7» n +-L _ y 

= Ax it) y + A 2 (t n+i ) y n + l + ^ 

y(x,0) = u 0 (x) , 

for i 2 = 0 , i 2 = N 2 , 
for i 1 = 0 , q = Ni , 


t = t 


n + 1/2 


with the boundary conditions 


( 34 ) 


y n + L = + i 


y = d 
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where 


and 


,n+i 




(A 2 aO<,„ = (A 2(t n )^{t n )) t 


A 2 (ffi + iMV+i) -Ao{t n )n{t ri 


The value /i is put in correspondence with the expression 


V n+i 4- y n r 2 

( 35 ) y =—2 -ij -( A 2 y)t,n, 


arising from the statement of the difference problem (33) during the course 
of the elimination of A\y. 

In this regard, it should be taken into account that scheme (33)—(34) 
is equivalent to the factorized scheme ( 20 )—( 21 ) with the member A a y — 
(a a (x) Vg a ) x in special cases: either in scheme (33) the operator A 2 (t) 
is involved at one and the same moment of time t in place of A 2 (t n ) and 
A 2 (f n +i) or ka( x ) an d) hence, A„ are independent of t. Recall that scheme 
( 20 ) provides on a solution u(x,t) an approximation of 0 (|/i| 2 ) + r 2 if the 
usual requirements of smoothness of k a (x) in the variables x y and x 2 are 
imposed in addition to conditions (31). The principal difference from the 
case of constant coefficients is discovered in the stability analysis of scheme 
( 20 ) by observing that the operators Ai = —A 1 and A 2 = — A 2 are positive 
and self-adjoint. But, unfortunately, they are non-commutative: 


Ai A 2 y = (ai(a 2 y £ J x . 2Sl ) ^A 2 A iy = (a 2 {a 1 y Sl ) XlS J 


where u a = a a (x,t). Just for this reason the product A 1 A 2 is not obliged 
to be positive, thus causing some difficulties. In view of this, it is possible 
to establish the stability only for sufficiently small values of r < n 0 ( c i)) 
where c 1 depends on the maximum of the derivatives of k a with respect to 
x 1 and x 2 . Let us stress here that r < r 0 (Cj) is a severe restriction and, as a 
matter of experience, it is connected with the available methods of special 
investigations of stability. In what follows we will show that scheme (33) is 
absolutely stable in another norm. 

With this aim, we first write down the equation for the error by in¬ 
troducing the new variables 


z -y 


~n +1 




n + 1 


y-u, 
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where u n = u(x,t n ), u n + l = u(x,t n+l ) and u is calculated by the formula 


(36) 


u = 


U n + M n + 1 

2 


4 


( A 2 u)t,n 


This is consistent with (35) as stated before. Under such a choice of ft we 
obtain the homogeneous boundary conditions for specifying z. 

By substituting into equation (33) y n = z n + u n , y = z + u and 
y n+1 = z n+l + u n+Y we are led to the problem statement 


(37) 


Oi 


A1 (^n +1 /2) ^ + A 2 (t n ) Z n + 


0.5- 


- A 1 (fn + 1 / 2 ) 2 + A 2(f„+l) Z n+l + 


z \ lh = 0 , z(.x-, 0 ) = 0 , 


(38) 

where -0" and 1 />" are the appropriate errors of approximation: 


V 1 " — A I (^n + I/ 2 ) 11 + A 2 (t n ) U n + <p n 


i>2 ~ Al(f„ + i/ 2 ) u + A 2 (f n + 1 ) U n+1 + l fi n ~ 


u — u 
0.5 r ’ 

,n +1 


U ' 1 — U 


0.5 r 


Before giving further motivations, it is worth noting here that r/>™ = 
0". This fact can readily be verified by substituting expression (36) into 
the formula 

? .n + l _ 9 fi 4 . v n 

c -r,= A 2 (f n+1 ) U-+ 1 - a 2 (fj U "-■■ = 0. 

At the next stage expression (36) is needed in the formula for the residual 

/ ?/ n -L f 1 7 \ 

^ = Ai(f n+1/2 ) (—^- T (A2<„) +A 2 (fJu n 

U " + 1 _ T 

+ 9 s 1 b-(A 2 rt) in . 
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with further reference to the following asymptotic relations: 


u n + u n+1 

--- = Ui-C'h.+l/ 

u n+1 - u n du 


u ( x ' 1 + 1 / 2 ) + °{ T ' 2 ), 
+ 0(t 2 ) , 


dt 


Si+1/2 


^2(f n+1 /2 ) u - ^2 (t n ) U n + - (A 2 u) i n + 0{t“) , 
Ai u T A 2 u ~ L\ u T A 2 u T O (| /i j 2 ), 

A™ = f > ^n + \ [2) + C , ( r2 + l^| 2 ) • 


As a final result we obtain 


7 ,« + l _ ,i n 

i’l = ( y ^-l u + ^2 (t )l<=< n + 1/ (2-0-1" l f n + C ) ( r “) 

= 0(r 2 + |/f), 

thereby justifying that scheme (33)—(34) generates a second-order approx¬ 
imation: 

0'/ = 4> n 2 = 0(r 2 + |h| 2 j . 

Further development of some a priori estimate for a solution of the 
problem concerned is mostly based on an operator-difference analog of prob¬ 
lem (37)—(38) such as 


(39) 


z — z n 

Q 5 T + ^i(t„ + i/ 2 ) ^ + A 2 (t n ) Z n = 0" , 

n + l _ ^ 

Q 5 r -9 ^l( i n + l/ 2 ) z + A 2 (t n + 1 ) z' l + l = ■02 


n = 0,1,2 ,... , 2 (0) = 0, 

where, Ai(t) and A 2 (t) are linear operators in a Hilbert space H: 

A 1 : H H , An : H 1 — H . 



558 Economical Difference Schemes for Multidimensional Problems 


In dealing with non-negative and, generally speaking, non-self-adjoint op¬ 
erators Ai > 0 and A 2 > 0, it will be sensible to omit for a while any 
subscripts and superscripts 

z = 2 n , z = z n+1 , 

^2 = ^2(f n + l) , A 2 = A 2 (t„) , A\ ~ Ai(t 1! + l jn) , 
allowing a simpler writing of the ensuing formulas: 

{E + 0.5 t Ai) z = (E — 0.5 t A 2 ) z + 0.5 t ^> 1 , 

(E + 0.5 t A 2 ) z = (E ~ 0.5 t Ai) z + 0.5 t tp 2 . 

The triangle inequality gives 

(40) || (E + 0.5 t Ai) z 1| < ||(£~0.5rA 2 )2|| + 0.5rH^ 1 ||, 

(41) || {E + 0.5 tA 2 ) z || < || (E - 0.5 r A t ) z || + 0.5 r || ip 2 || . 

An auxiliary lemma may be useful in the sequel. 

Lemma 1 If A > 0 is a linear operator in a Hilbert space H, then 

(42) || (E — (1 — < 7 ) r A) y || < || (E + u r A) y || for a > 0.5 . 

This assertion is an immediate implication of the chain of the relations 

|| (£ + < 77 -A) j/1| 2 - || {E - (1 - eg) r A) y || 2 

= 2 t {Ay, y) + 2 (<7 - 0.5) r 2 || Ay || 2 > 0 , 

which are valid for a > 0.5 and the operator A > 0. 

Collecting inequalities (40) and (41) and taking into account estimate 
(42) with the value a = 0.5 incorporated, we proceed to the elimination of 
5. Following established practice, we arrive at 

|| (E + 0.5 tA 2 ) z || < |1 (E + 0.5 tA 2 ) z\\ + ^ (|| i/h || + || ip 2 ||) , 

yielding with the aid of inequality (42) either 

|| (E+ 0.5 tA 2 )-z || < \\{E + 0.5 tA 2 )z\\ + ^ (H^ \\ + \\i> 2 II) 
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or 

|| (E + 0.brA 2 (t k+l )) z k+l || < || (£ + 0.5 r A 2 (t k )) z k \\ + L (|| || + || ||) . 

Summing up over k — 0,1, ... , n and inserting z° = 0, we find that 

(43) lk n+1 H (1) = ||(£ + 0.5r+ 2 (t„ + 1 ))z^|| 

<*I>(ii^ii + ii^ii), 

Z k -0 

where. 

(44) ll-'ll^, = || (E + 0.5 r.+,) c || 2 = || * || 2 + r (A 2 z, z) + ^ || + 2 c || 2 . 

Observe that estimate (43) remains unchanged if the norm |M| (1 ) is replaced 
either by the norm || z || or by the norm 



by virtue of the relations 

||z|| 2 < ||z|| f 2 n and |M| 2 2) < IkH 2 ^. 

This type of situation is covered by the following assertion. 

Theorem 3 Scheme (33)—(34) is absolutely stable (for any h 1) h 2 and t) 
and converges with the rate 0(|/i| 2 ) + r 2 in the norm || • ||^ given by formula 
(44) under the conditions which guarantee a second-order approximation 
on a solution u = u(x,t) of problem (32). 

Recall that a second-order accuracy of scheme (33)—(34) is ensured 
by making a special choice of the boundary conditions for the intermediate 
value y — y such as 

p n + p n+l t 2 

y = p for ij = 0, N x , p = --- - (A 2 p) i n , 

It is possible to demonstrate that the accuracy 0(|h| 2 ) + r 2 of this 
scheme remains unchanged if we might agree to consider 

p n +p n+l 

y = — 5 — 


(45) 


for i j = 0, Ni . 
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This means that the second term 0(r 2 ) in the available exppression for jj, 
will be excluded from further consideration. The proof of this statement 
is omitted here. As a matter of fact, the stability of the scheme at hand 
with respect to the boundary conditions is revealed through such a stability 
analysis. 

It is worth mentioning here several things for later use. Scheme (33) 
with the boundary conditions (45) is in common usage for “step-shaped” 
regions G, whose sides are parallel to the coordinate axes. In the case of an 
arbitrary domain this scheme is of accuracy 0(\h\ 2 + r 2 \/h). Scheme (9)- 
( 10 ) cannot be formally generalized for the three-dimensional case, since 
the instability is revealed in the resulting scheme. 

6. A higher-accuracy scheme. By minor changes we are led to a higher- 
accuracy scheme such as 


yn + l/2 _ n 


= (Tj Ai ij n+1/2 + (1 - <t 2 ) A 2 y n + 


(46) 


y n + 1 _ yU + l/2 


(1 - cr 1 )A 1 y n + 1 / 2 + (t 2 A 2 y n+1 + (1 - 04 ) 


x6<+ h , n = 0,1,2,..., y(x, 0) = u 0 (x ), x6u> h , 
(47) y n+1 = y n+1 for i 2 = 0 , i 2 = N 2 , 

yn+l /2 _ ^ f or j^ — o , i 1 = Ni , 

where 


A P n+1 + (1 ~ ^i) A*" ~ t A 2 (a i a 2 y n+1 - (1 - 04 ) (1 - cr 2 ) a") 


h 2 

a 

12 r 


/ h 2 ti 1 ' 


'n+1/2 


It is plain to show that the scheme in view is stable and generates an 
approximation of 0(r 2 + |h| 4 ). With this aim, it seems worthwhile to design 
a factorized scheme for the same reason as before. The starting point is to 
eliminate y n+ i/ 2 from equations (46) in the process of transformations 


(48) B l if+ l / 2 = C 2 y n +a 1 Tv n > CV /+ 1 / 2 - B 2 y n+l - (1 - n,) r p" 
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where B a = E — cr a T A a and C a = E + (1 — u a ) r A a , a = 1,2. 

Having multiplied the first equation (48) by 1 — cr l and the second one 
by (Tj and having added the final result, we find with the aid of the relation 
(1 — crJ5i + <t x C\ = E the intermediate value 

(49) y n + 1 / 2 = a l B 2 y n+l +(l~a 1 )C 2 y n . 

Substituting this expression into the first equation (48) yields 

o - ! By B 2 y n+l = (C 2 - (1 - <t 1 ) By C 2 ) y n + r <p n 


,/> + ! _ u n 

(50) By B 2 = (A t + A 2 + (1 - <7, - <t 3 ) r Ay A 2 ) y n + Y . 


By observing that 


<t 2 ) r = 


h* + h\ 

12 


this provides enough reason to rewrite the preciding scheme as 


^.n+l - yll 

(51) By B 2 - J - = AY + Y , X 6 ^ , 

T 

(52) y(x, 0) = u 0 (x) for x 6 A> h , y n = y n for x 6 y h , 
where 

h 2 -\- h^ 

A 'y = {Ay + A 2 ) y + 1 12 2 A t A 2 y . 

Simple algebra gives 


(53) 


= A'u n + Y - By B 2 




0{t 2 + \h\ 4 ). 


thereby justifying that scheme (51)—(52) generates an approximation of 
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0(t 2 + |/i| 4 ). This is due to the asymptotic expansions 


( h 2 h 2 h 2 + h 2 

A 'u n + ip n = (lu+^L 2 u+^L 2 u + 


Li L'2 u 


+ <P n +0(\h \ 4 ) 


' h? hi \ dn h 2 , hi 

— Li~\—- Lo\ - —\- Lu - L LJ -~2-L->f 

12 12 “ dt 12 U 12 2J 


‘P n +0{\h,\ 


B.B-2 


n + l 


u t ~ o (Ai + A 2 ) 


H + Y2 y ^ lUi if 


0(r 2 + |h| 4 ) 


(du t d 2 u t du h 2 du h 2 du\ 

ydt + 2~dt 2 ~2 L ~dt + U LL ~dt + U L2 ~dtJ t _ t 


+ 0(r 2 +\h\*), 

arising from the well-established relations 

dh 

fffi* — — L 1 L 2 u + L a —— L a f , a = 1,2. 
of 

Further stability analysis is connected with the homogeneous bouncl- 

0 

ary conditions. In preparation for this, we introduce the space H = Q h of 

0 

grid functions and refer to the operators A a y = — y xx , V £ f lh, as sug¬ 
gested before. All this enables us to concentrate on an operator-difference 
scheme 

(54) By t + A'y = ip{t) , 0 <t = nr, y(0) = u 0 , 

with the members 


B — (E + t Ai) (E + a 2 t A 2 ) , A' — Ai + A 2 — (x t + x 2 ) Ai A 2 , 
= a a = 0.5 - x a /r , a =1,2. 
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Here the operators T| and A--> are supposed to be self-adjoint, positive 
and commuting: 

A\ = A\ > 0 , A*2 = A 2 > 0 , A\ A 2 = A 2 Ai , 

implying that (Hi A 2 )* = Ai A 2 > 0. 

The simple observations that || A a || < 4//i 2 and x a || A a || <1/3 may 
be of help in verifying the stability condition in the space H A : B > 0.5 r A' . 
Furthermore, with the aid of the inequality A a < || A a || E we obtain 

B — — A' — E — Xj Ai — k 2 A2 + — (xj + x 2 ) A 1 A 2 

+ (l ~ k ^) A ^ 

~ E — k^Al\ — >£"2^2 H - —I - A1A.2 

> E - X, || Ay II E - x 2 1 | A; II E < l -E , 

meaning B > 0.5 rA' + if/3 and confirming the stability of the scheme in 
view in the space H A i. 

In particular, Theorem 7 in Chapter 6, Section 2 states that scheme 

(54) satisfies the a priori estimate 

(55) y +1 \\ A '<\\y 0 \\ A ‘ + ]fl[i2 HI Ell 2 

V Vj'=o 

In trying to evaluate the accuracy of scheme (53) we set up the problem 
for the error z n+l = y n+l — u n+l : 

B z-f + A 1 z — 'ip , z(0) = 0, 

whose solution obeys estimate (55) 

(56) (X>llE|| 2 

Vj'= 0 

In passing from (55) to (56) we have taken into account that = y° — u° = 
0 and that the operator A' must satisfy the inequalities 
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which are immediate implications of the chain of the relations 

2 

A' = A — (xj + x 2 ) A 1 A 2 > A — || Ai || A 2 — x 2 1| A 2 1| Ai > — A . 

Estimate (56) serves to motivate that scheme (51)—(52) and one of its equiv¬ 
alent schemes, namely scheme (46)-(47) converge in the space Ii 4 with the 
rate 0(r 2 + |/r| 4 ). 


Remark By analogy with the preceding section it is possible to evaluate 
the errors of approximation for either of the equations (48) such as 


A 


C 2 u r ' 


B 1 u 


+ a 1 ip n 


i>2 


Ci u - B 2 u n+l 




This can be done using formula (49) for the intermediate value, u of artificial 
character 


u = (T 1 f? 2 M n+1 + (1 — of) C 2 I 1 1 ■ 


Upon substituting this fictitious value into the above formula for 1 f > 1 we find 
that 

h = a', 

<7, 


B 


+ = U 


thereby clarifying that the quantity tj\ a 1 coincides with the error of approx¬ 
imation for the factorized scheme (51) that is known to us from formula 
(5S). 

By virtue of the relation 


>h _ 1> 2 

a 1 1 — < t 2 

we can be pretty sure that every of the equations (48) generates an approx¬ 
imation of 0(|/i| 4 + r 2 ). 

9.2 ECONOMICAL FACTORIZED SCHEMES 

1. Schemes with factorized operator. We now consider the two-layer dif¬ 
ference scheme 


(1) B y 1 + A y = ip , 0 <t = jr<t 0 , 


j = 0,1,... , 1 /( 0 ) = y 0 . 



Economical factorized schemes 


565 


Knowing the value y = y 3 on the jth layer, it is required to find the value 
t/ J + 1 . In preparation for this, we derive the equation related to j/ J + 1 with 
a known right-hand side F J : 

(2) Bij + l =Fi, F* = (B-TA)/yi +T<p>, j = 0,1. 

As can readily be observed, O(N) operations are needed in giving and 
their amount is proportional to the total number of the grid nodes. This 
is certainly so with any difference scheme, whose pattern is independent 
of the grid. From equation (2) it is easily seen that the stable scheme (2) 
will be “economical” once the users perform 0 (N ) operations while solving 
equation (2). 

Let “economical” operators B a , a = 1,2,... ,p, be such that O(N) 
operations are necessary in connection with solving the equation 

(3) B a v = F. 

Then scheme (1) with a factorized operator B of the structure 

(4) B = B L B 2 ■■■ B p 

will also be “economical” in line with established priorities: the numeri¬ 
cal solution to equation (2) with operator (4) requires 0(N ) operations. 
Indeed, a solution to the equation 

(5) B,B 2 ■■■ B p y > +1 = F* 

can be found by successive solution of p equations of the form (3): 

(6) B L y (l) -F J , B L py ia) -y Lu _ l) , a = 2, 3,. .. ,p , 

so that ij +1 = i/ (p) . Here y (1) = y J + 1/p , . . ., y^ a) = y j+a/p , . . ., 1} = 

yi+ip-F/p stand for intermediate values arising in the process of calcula¬ 
tions, It follows from the foregoing that the stable scheme (1) with the 
factorized operator B being a product of a finite number of “economical” 
operators Bi ) .. . , B p becomes “economical”, so there is some reason to be 
concerned about this. All the schemes with a factorized operator B are 
called factorized schemes. It was shown in Section 1 that the economi¬ 
cal alternating direction scheme is equivalent to the factorized scheme with 
the operator 


(7) B = B 1 B 2 , B a = E — 0.5 r A„ , 


y Vx a X Q r 


a = 1,2. 
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Especial attention is being paid to the factorized schemes with the members 


( 8 ) 


B — H\ H 2 , B a — E -\- t R a , 


R iy = J2 



R2V 


Er' 


a= 1 


where Ri and f? 2 are “triangle” operators with associated triangle matrices. 
These fall within the category of explicit alternating direction schemes. Let 
us stress here that the operators Ri and f? 2 may be, generally speaking, 
non-self-adjoint, but they are always mutually adjoint to each other. In 
that case a solution to equation (3) can be found by “through execution” 
formulas. 

Undoubtedly, the reader comes across difference operators B a of the 
structure B a = E-crrA a , where A a approximates the differential operator 
L a with partial derivatives of one argument x a . For example, if L a u = 
d 2 u/dx 2 a , then A a y — y SaXa is a three-point operator, whose use permits 
us to solve equation (3) by the elimination method. It is worth mentioning 
here that any difference scheme can be reduced to a sequence of simpler 
schemes in a number of different ways. This is certainly so with scheme 
(1), implying that 

y J + l = y 3 + r w 3 , 

where w J is a solution to the equation 

(9) Bi B 2 ■ ■ ■ B p iu — tb 7 , tb 7 = if 3 — Ay 2 . 


The value w 7 can be recovered from the governing system of p equations 


(10) B iw (1) = <b 7 , B a w (a) = w (a _ 1} , a = 2,3,... ,p, 
with further reference to 


(11) iu J =w {p} . 

It is worth recalling here that the first economical schemes were intended 
for the elimination of intermediate values with no problems. The main idea 
behind this approach is to involve factorized schemes “in integer steps”, 
a key role of which is to relate the values y 7 and j/ 7 + 1 in some or other 
convenient ways. 
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2. The boundary conditions. As one might expect, stability and approx¬ 
imation take place for the factorized scheme (1). In this view, it, seems 
reasonable to adopt equations ( 6 ) or ( 10 )— ( 11 ) as a perfect computational 
algorithm in designing the factorized scheme (1). But this equivalence can 
be established only with consistent boundary conditions and needs certain 
clarification. 

In the forthcoming example the first boundary-value problem is posed 
for the heat conduction equation in the rectangle (I?o — {0 < ic x < , 0 < 

x 2 < 4 } with the boundary F: 

0 u, 

(12) = (Li + L 2 ) u + f(x,t ), u\ r = y(x,t), u(x,0) - u 0 {x) , 

where L a u = d 2 u/dx 2 a , a = 1,2. 

We begin by placing the factorized scheme (1) with A a y = y XaXa on a 
rectangular grid Q h = {(q h 1) i 2 h 2 )} with steps h 1 and h 2 in the, specified 
domain Gq: 

(13) 5i B 2 y t = Ay + <p , y 3 = y 3 , if = u 0 (x) . 

Here and in all that follows B a = E — utA a , A = Ai + A 2 and is the 
boundary of the grid uj h . In passing from one layer to another algorithm 
( 6 ) is performed for problem (13): 

(14) Biy^ = F 3 , F 3 = (Si B 2 + t A) y 3 + r f , B 2 f + 1 = ?y( r) , 

which is put together with the boundary conditions y 3 + l \ = y 3 + l ■ 

'yh 

As far as the operator B\ B 2 on iJ h is concerned (including the bound¬ 
ary Xj = 0, x x = /j), the equation B 2 y 3 + l = should be valid not only 
for 0 < Xj < /j, but also on the boundary for x 1 = 0 and x 1 = /j. Since 

the values y 3 +1 1 = y 3 + l are already known, it follows from the foregoing 

’h 

that 

(15) 3 /^ = (E — a t A 2 ) y 3 + 1 = y 3 + i — u r A 2 y 3+1 for Xj=0,/j. 

When specifying for x i = 0, / 1 by the preceding formula, problems 
(13) and (14)—(15) become equivalent. This fact can easily be verified 
during the course of the elimination of from (14). In the framework of 
the second algorithm we accept 

B x w (1) = $ J ', &=Ay> +</>>, 

(16) 

B 2 uq 2 ) = uq 1 ), y 3 + =y J +rcO|' 2 ) 
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and the boundary conditions are imposed to be 


//J + l _ Ijj 

u; (1) = (£ <ttA 2 ) 

for 

J-3 

11 

O 

fi j + l - 
W (2) - r 

for 

a; 2 = o ,/ 2 


that is, w (1 j = 0 and = 0 on the boundary j h if /./ is independent of t. 

Observe that in giving scheme (1) in matrix (operator) form it is pos¬ 
sible to take into consideration the homogeneous boundary conditions by 
rearranging the right-hand side p at the near-boundary nodes. The design 
of the factorized scheme also involves the homogeneous boundary conditions 
= y 3 =0, = u>( 2 ) — 0 for x G 7/J, but the retention of the approx¬ 

imation order necessitates imposing the extra member —<7 2 r 2 /i“ 2 A 2 yU ( on 
the right-hand side of this scheme at the near-boundary nodes for i l = 1 
and ij — N L — 1. 

3. Constructions of economical factorized schemes. Using the regulariza¬ 
tion method behind, we try to develop the general method for constructing 
stable economical difference schemes on the basis of the primary stable 
scheme 

y n +l — y n 

(18) B -- — + Ay n =p n 

T 

with an operator of the structure 

(19) B = E + t R . 

The relation B > 0.5 tA is ensured by the stability property of this scheme. 

In such a setting it is preassumed that R is a sum of a finite number 
of “economical” operators R a , a = 1,2,... ,p: 

(20) R = Ri + • • • + R P ■ 

The operator B can be factorized by replacing B — E + r (f?i + • ■ ■ + R p ) 
by the factorized operator 

(21) B = B\ • ■ ■ B p , B a = E + t R a , 

making it possible to ignore the primary scheme (1) in favour of the factor¬ 
ized scheme 


( 22 ) 


Bi ■ ■ ■ B p y t + A y = <p . 
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Sometimes such a passage permits one to justify the approximation being 
(p instead of p near the boundary of the grid domain, 


If the primary scheme (18) is stable, then so is the fac¬ 
torized scheme (22) in the case, where the operators R L , 
R 2 , ... , R p are self-adjoint (R a = R* a ), non-negative 
(Re > 0) and pairwise commutative (R a Rp = Rp R a , 
a, P = 1,2, ... ,p). 


By virtue of the indicated properties of the operators R a their prod¬ 
ucts R a Rp, R a Rp R-y, etc., will be self-adjoint non-negative linear opera¬ 
tors. This provides enough reason to conclude that 


B — Bi f ?2 = E + r (f?i + Rn ) + t j Ri R 2 


= B + t 2 RiR 2 >B for p= 2, 

B — B\ B 2 ■ ■ • Bp — E -\- t (f?i + R'2 + ■ • • + Rp) + t 2 Qp 


= B + t 2 Q p > B , 
where Q* — Q p >0. 

Thus, B > B > 0.5 tA, meaning the stability of the factorized scheme 
(22). The operators R a are so chosen as to satisfy the condition of approx¬ 
imation, too. The forthcoming example helps clarify what is done. 

Example 1 We are looking for a solution of the first boundary-value 
problem for the heat conduction equation with variable coefficients 


(23) — L\ u T u -)- f (x , t), x £ (d , t t> 0 , 

u\ r - p{x,t), u(x, 0) = u 0 (x), 

0 01 

L a 'll — ^ ^ or (^ ^ ^ ^ ^ a — ( -'2> ^ ^ ^ , 

G - {0 < < l a) a = 1,2}. 
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For this, we have occasion to use the two-layer factorized scheme 


(24) (E + t Ri) (E + t R2) y t + Ay — if , 

t = nr , n =0,1,... , 
y\ lh - MM) > t - nr > 0 , 
y(x, 0) = u 0 (x) , x G u h , 

where ui h = {ap = (ij h 1 , i 2 /i 2 )> i a = 0,1,... , Afo, /i a fV a = l a , a = 1,2} is 
the grid in the rectangle G with the boundary j h . 

The operator L a is approximated to second order by the difference 
operator 

A a iy = (a„(M) Vx a ) x . 0 < c 1 < a a (x, t) < c 2 , a = l,2. 

Let 

A = —(Ax + A 2 ) , R a = -<Tc 2 A a , a =1,2, 

0 

where A a y = jy fii , rQ . 

Stability analysis is mostly based on the assumptions that the bound- 

0 

ary conditions are homogeneous and H = Q /,. is the space of all grid func¬ 
tions given on the grid Q h and vanishing on the boundary ■j h . The inner 
product structure is the same as suggested before for problem (22). A brief 
survey of the properties of the operators A and R a as operators in that 
space H is presented below: 


A = A* > 0, A a <c 2 Aa, A a y=-A a y for any r/Gffo, 

(25) 

R a — a c 2 A a , R a = R* a > 0 , a = 1,2 , R x R 2 = R2 Ri . 

As can readily be observed, the stability condition 

B = (E + rf?i) (E + tR-x) > 0.5 tA 

will be ensured if <7 > 0,5 or even if <7 > 0.5 — l/(r|| A||), It seems clear 
that the three-point difference operators B a — E + rR a with constant 
coefficients are “economical’’, since the equations 

B a u> = {E + rR a ) u> = F a , a = 1,2, 
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can be solved using Gaussian elimination along the rows for a = 1 as well 
as along the columns for a — 2. 

Under such an approach the factorized scheme is of no less than first- 
order accuracy in r, In a similar way an economical factorized scheme can 
be designed in the p-dimensional case when 

(23') = E L a u + / 

Q'= 1 

and the operator L a is specified by formula (23), If so, we might agree to 
consider 

v 

b = n(£+^«)- 

or—1 

Here the operators R a are of the same structure as was chosen for p — 2. 

Example 2 The statement of the first boundary-value problem for the 
parabolic equation with mixed derivatives in the parallelepiped Go — {0 < 
x a < L, a — 1)2,... ,p} is 


(26) — = Lu + f(x,t), w| r =/i(x, t) , u(x t 0) = u 0 (x) , 



P P P 

0<gEC< E k a p{x,t)Z a Zp <G EC’ 

or=l a,P=l or= 1 

As the operators R a involved, we take once again the operators specified 

by formulas (25) that are self-adjoint, positive (for a > 0) and pairwise 

0 

commutative in the space Qa, since Go is a parallelepiped. The scheme 
with these members is stable for a > 0,5, As far as B a = E + rR a , 
a = 1,2,,,. , p, are three-point difference operators with constant coeffi¬ 
cients, the possible follow up is the algorithm suggested in Example 1 for 
determination of y 3 + 1 on the basis of y 3 . We will not pursue analysis of 
this: the ideas needed to do so have been covered. 
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Example 3 As a matter of experience, the intention is to use a higher- 
accuracy scheme similar to (12) being used for the heat conduction equa¬ 
tion. As we have stated in Section 1, the factorized scheme 


(27) 


where 

(28) 


(E - cq r Ai) ( E - <t 2 t A 2 )y t = A'y + ip, 
x G u> h , 0 < i = nr , 

v\-y h = /'(O . t = nr , y(x,0) = u 0 (x ), x £ 


A' = Ai + A 2 + Ai A 2 , 


12 


1 h 2 

= <T " = 2 ^ if ’ Q ' = 1 ’ 2 ’ 


^ = ( /+ T2 Al/+ 12 A2/ 


n + l/2 


generates an approximation of 0(r 2 + |/i| 4 ). 

Also, the scheme so constructed is equivalent to the alternating di¬ 
rection scheme (46)-(47) from Section 1, Among other schemes, the users 
prefer two alternating direction schemes, either of which is equivalent to 
scheme (27). 

The first scheme: 

(E + cr 1 t Ai) y = ((E - cr 1 t Ai)(E - cr 2 t A 2 ) + t A 1 ) y + t (p , 

(E ~ <t 2 t A 2 ) y = y. 

Every equation refers to two-layer schemes with a common canonical form 
(29) (E — a 1 r Ay) '-—- = A 1 t/+(l-cr 2 )A 2 i/ 

T 

+ (Xj + x 2 + r <Xj<7 2 ) A x A 2 y + <p, 

. y — y h 2 

(E - cr 2 r A 2 ) ; -- = a 2 A 2 y , x a = -%■ , 


T 


a = 1,2. 
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In turn, the supplementary boundary conditions become 


(30) 


y n = /J n for i 2 = 0, tV 2 , 

y = (E — a 2 t A 2 ) fi n+1 for i 1 — 0, Ni. 


The second scheme: 


(31) 


(E — cr l T ki) - —- = A 'y + ip, 


(E - cr 2 rA 2 ) --- = <j 2 k(y- y) 

T 


with the supplementary boundary conditions for y: 


u n + 1 ~ ,, n 

(32) y = fi n + t (E ~ t cr 2 A 2 )- for i 1 =0, Ni 


Then problems (29)—(30) and (31)—(32) can be solved by the alter¬ 
nating direction method in just the same way as was done in Section 1 
for problem (46)—(47) using Gaussian elimination along the rows as well as 
along the columns of the grid u> h . 

Thus, three different examples of interest bring out the indisputable 
merit of the alternating direction method and unveil its potential. From 
what has been said above it follows that the factorized schemes find some 
range of applications solely in rectangles and parallelepipeds and no more. 
The only exception is the case B = B 1 B 2 , B a — E + rR a , where and 
f ?2 are “triangle” operators, by means of which it is possible to generate a 
lower-order approximation only under the condition r = 0 (h 2 ). 

4 . Three -layer factorized schemes. Being concerned with economical three- 
layer schemes, we confine ourselves here to 


Bijo + T 2 Ry h + Ay = ip , 0 <t=jr<t 0> y(0) = y ot y{r) = ■y 1 . 

A first step towards the solution of this difference problem is to solve it 
with respect to leading to 

(5 + 2 tR) if + 1 = 2r (2R — A) if + (B - 2 tR) if 1 + 2r^. 


Because of this form, the operator B + 2 tR on the upper layer is yet to be 
factorized for economical reasons. 
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In what follows the weighted scheme 


(33) ijo + Aia^y + (1 - - a 2 )ij + a 2 y) = ip , 

y(0) = y o . y{r) = y i, 

is treated as a primary one and it will be written in canonical form for later 


(34) (E+r(a 1 - a 2 ) A) y* +0.5(cr 1 + a 2 ) t 2 Ay u + Ay = f t 

where the unknown operator B + 2 tR — E + 2cr 1 rA is sought. Let now 
A = Ai + A 2 . The factorized operator 

B + 2 tR = (E + 2 <7j tAi)(E + 2 ct^tAi) — E + 2 tA + 4 <t 2 t 2 AiA 2 

will appear in place of the operator B + 2 tR as one possible way of con¬ 
necting two operators B and R by a unique condition and it may be of 
assistance in designing many factorized schemes. Later we will expound 
certain exploratory devices for obtaining them. For example, this can be 
done using (34) in the form 

(B + 2 tR) y t + (B — 2 r R) ijj + 2 A y = 2 if 

and replacing the operator B + 2 tR by the factorized operator B + 2 tR, 
making it possible to write the scheme at hand in canonical form with the 
aid of the well-known relations 


Vt =V° + 0.5 r y h , y f = y= - 0.5 r y u . 


The outcome of this is 

(35) (E + t (cr 1 - a 2 ) A+ 2 a 2 t 2 Ai A 2 ) y<= 

+ T 2 ( a -2 ~ . a l A + a 2 tAx A 2 S j iy {t +Ay = f, 
?/(0) = !/ o , 1 /(t)=?/i, 

so that 

B — B + 2<t 2 t 2 Ai A 2 , R = R + u 2 rAy A 2 . 
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Knowing the values y J 1 and y 3 we do follow the same algorithm for 
determination of the value y 3+1 , whose use permits us to find that 


Biui (1) = F J , 


F j = (2 r R ~ B) d - 2 A y j + 2 , 


B '2 ^( 2 ) — W (1 )> + 1 — yi + T w ( 2 )> 


B\ — E + 2 <7j r Ai, f ?2 = if + 2 (Tj r A 2 . 

A similar procedure works for the boundary conditions imposed for as 
was done for a two-layer factorized scheme and for this reason it is omitted 
here. 

Stability of the factorized scheme (35) can be established on account 
of the general theorems from Chapter 6, Section 3, due to which it follows 
from the foregoing that the conditions 

<r 1 > <j 2 1 crj + u 2 > 0.5 , A a = A* a > 0 , Ai A 2 = A 2 Ai 

are sufficient for the stability of the scheme concerned. If cr 1 > cr 2 , cr 1 + a 2 > 
0.5, A a — A* > 0, then the primary scheme is stable, since B > E and 
4 R > A. As far as the operators Ai and A 2 are commuting, we deduce 
that AiA 2 > 0, meaning B > B and R> R. Due to this fact the stability 
of the primary scheme implies that of the factorized scheme (35). 

A particular case where R = a A, a — 0.5 (a l +a 2 ), is showing the gate¬ 
way to the future research, whose aims and scope are connected with the 
general method for constructing three-layer economical factorized schemes 
by means of the regularization principle of difference schemes. A simple 
example 

(36) yo +r 2 Ry it + Ay = ip, 0 <t-jT<t 0 , y(0)=u o , y{r) = u 0 , 

can add interest and help in understanding. Later we will elaborate on 
this for rather complicated cases. Here the value y(r) — u 0 for t = t is so 
taken as to provide a second-order approximation in r. Also, the stability 
property guides a proper choice of the operator R. 

That is why a reasonable form of the primary scheme is 

(37) {E + 2 tR) y t = ~F , F = (2 tR - E) y- t - 2 A y + 2 tp . 

Let R be a sum of “economical” operators such that R = i?i+i? 2 + ' • - + R P - 
By replacing in (37) the operator 

E + 2 tR = E + 2 r ^ R a 

a=l 
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by the factorized operator 

p 

E + 2 tR = PJ (E + 2 r f? a ) = i? + 2 r f? + 4 t 2 Q p , R = f? + 2 rQ p , 

«=i 


where Q p = f?i f?2 for p — 2 and Q p — Ri R2 + R1 R3 + R2 f?3 + 2 rf?i f?2 -R3 
for p = 3 , etc,, the structure of the factorized scheme is 

(38) Bi ■ ■ ■ B p y t = -F , B a = E + 2 r . 

The canonical form is given by 

(39) Byo + t 2 R y h + Ay — ip , 

where B = E + 2 t 2 Q p and R = R + tQ p . 

Let now ip 0 (u) be the error of approximation in the class of solutions 
u — u(x,t) of the continuous problem for the primary scheme (36) and 
i/ij(u) be the same quantity for the factorized scheme (39). In this regard, 
it should be noted that 

V’i(w) = t'' 0 («) + 4*, 4* — %T 2 Q p u t . 

When ||<5 p u ( ||^.^ = 0(1) is accepted in some suitable grid norm || • 

built into stability theorems, we might achieve = 0(t 2 ) and in 

passing from the primary scheme to the economical factorized scheme (38) 

the error of approximation changes within a quantity of 0(r 2 ). Following 

these procedures, we obtain economical factorized schemes of second-order 

accuracy in r as stated before due to the extra smoothness of the solution 

u. Such a stability analysis of schemes (36) and (39) is mostly based on the 

further treatment of the operators R and A as linear operators acting from 
0 

the space H = Q h into the space H. In particular, this means that the 
boundary conditions on j h are homogeneous for a scheme approximating 
(26). 

Under the natural premises 

A = A* > 0 , R a =R* a >0, a ~ 1,2,... ,p, 

another conclusion can be drawn that the primary scheme (36) is stable, 
provided the condition 


R > 




(40) 


4 


£ > 0 
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holds. 

In the case of a variable operator A = A(t) it is required, in addition, 
that A(t) is Lipshitz continuous in t, allowing the operator R to be constant. 
In the situation when the operators R a are pairwise commutative, the 
stability of the primary scheme implies that of the factorized scheme (39), 
since Q p > 0, B = E + 2 r 2 Q r > E and R = R + tQ p , giving 


Let us stress that the well-founded choice of the regularizer R is in 
complete agreement with an approved principle governing what can happen 
and depends on the range of situations to be considered. This is certainly 
so with two-layer and three-layer schemes and, therefore, one and the same 
regularizer R could be useful and perceived to be useful for different oper¬ 
ators A, 


Example 4 By having recourse to problem (23) associated with the heat 
conduction equation with variable coefficients for the same choice of the 
operators A, R\ and R 2 as in Example 1 for the two-layer economical 
scheme (24) we concentrate on the primary scheme (36) 

ijo + t 2 R y it + Ay = ip, R = R y + R 2 , 

which generates an approximation of order 2 and possesses the residual 
0 = 0(r 2 + |/i| 2 ), This scheme is stable for <r > (1 + e)/4. Observe that 
the factorized scheme of the type (39) with the members 

B — E + 2 r 2 Ry Rn , R — R -\- t Ry R 2 


turns out to be absolutely stable for a > (1 + e)/4, £ > 0. This is due to 
the fact that the operators Ry and R 2 are commuting. 

Also, the operator A(t) will be Lipshitz continuous if we agree to 
consider 

|(OJ < c 3 ci a , c 3 = const > 0 , a = 1,2 . 

Since every operator B a — E + 2 rR a is “economical”, the same property 
holds true for scheme (39). 

In an attempt to solve the system of difference equations 


ByB 2 y t ~ ~F 


y\ lh - d, 


B a — E + 2 rR a , 
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the following algorithm is recommended for the possible applications: 


B l W(i) - 

-F, 

i G uJ h , 

U> ([) = B 2 /J, t for x 1 -- 

= 0,/j 

J32 ^(2) “ 

w (i)> 

X £ui h , 

w ( 2 ) = Ah for x 2 z 

= o ,/ 2 


y 3+1 = V 3 + ™ (2) . 

In this context, we should focus the reader’s attention on the process of 
specifications of boundary conditions by doing Gaussian elimination along 
the rows for and along the columns for When //. happens to be 

independent off, that is, /.« = y(x), the quantities and satisfy the 
homogeneous boundary conditions. 

Example 5 In tackling problem (26) the operator L is approximated by 
the difference operator 

v 

A y = 0.5 [(k a p(x,t)y Sfl ) x ^ + (k af} (x,t) y x . ff ) _)^ 

or,j0=l 

with the coefficients k a p still subject to the following conditions with con¬ 
stants c 2 > c x > 0: 

p p v 

Y1 k aiP X P)Z a ty < c 2 Y1 ft fOT a11 ' E e G 0: t >°- 

a=L a J j3=[ cx=[ 

Having stipulated the condition \(k a p) t \ < c 3 , where c 3 = const, the oper- 

0 

ator A(t)y — —A (t)y is Lipshitz continuous in the space H — fi Also, it 
will be sensible to approve the same selection rule for the regularizer as in 
the preceding example: 

p 

E O 0 

R a , R a y =-<j c 2 A a y, A a y=y SaXa . 

cv = l 


In that case the factorized scheme (39) is stable under condition (40) 
or, what amounts to the same, for <r > (1 + e)/4, e > 0, and it is of 
second-order accuracy with respect to all the variables. 
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Ill this direction, the intention is to construct in a similar manner the 
factorized scheme related to another primary scheme 

v 

(41) (E + T 2 R)y- u + Ay = ip, 

CX — 1 

where the operators R a are pairwise commutative, self-adjoint and posi¬ 
tive. This scheme is certainly associated with the hyperbolic type equation 
d 2 u/dt 2 = Lu + f. There are several mechanisms for passing from scheme 

(41) to the factorized scheme with the accompanying factorized operator at 
the members y, y^ or y t . The usual way of covering this is connected with 
further replacement of the operator E + t 2 R by the factorized operator 

~ p _ 

E + t 2 R — ( E + t 2 R a ), R — R -\- t 2 Q p , Q p = Q p > 0 , 

a=l 

leaving us with the scheme 

(E + r 2 R)y t - t + Ay = <p , 

which is stable only if the primary scheme is stable, since R = R* > R. 
The resulting scheme differs from the primary one within a quantity 0(r 2 ). 

Example 6 To avoid generality for which we have no real need, the 
object of investigation is the equation of hyperbolic type in the rectangle 
Gq = {0 < x a < l a , a = 1, 2}. The boundary conditions of the first kind 
are specified on its boundary T. The complete posing of the problem is 
described by 

d 2 u d 2 u 

(42) = (L i + L 2 ) it + f(x , t ), L a u— , a = G 2 , 

x 6 Go , t G (0, T] , 
w| r = y(x, t) , t > 0 , u[x, 0) = u 0 (x ), 
dii . , , =, 

(x,UJ — ^ G Gq . 

We contrived to do the necessary factorization in a number of different 
ways. First, we initiated the construction of a primary weighted scheme on 
an equidistant rectangular grid 


Q h = { x i - {hh u i 2 h 2 ), i a = 0,1,. .. , AG, h a N a = l a , a = 1, 2} 
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on which the statement of the difference problem is 


(43) y n = A (ay+(1-2 a)y+ay) + p(x,t ), 

t = jr , j - 1,2,..., x G u> h , 

?/l 7/! = /4-M) , l-ir, j> 0. 
y(a;,0) = k 0 (x) , % (x, 0) = w 0 (x), x G , 

where u 0 (x) = u 0 (x) + 0.5 r(iu 0 + /(x, 0)), A = A x + A 2 and A a y = y SaXa . 

Assuming the primary scheme (43) to be stable, that is, granting 
4a > 1 + e, e > 0, we rewrite scheme (43) in the canonical form 

(E - a t 2 A) y Tt = A y + p, 

whose use permits us to turn to the economical factorized scheme 

(44) (E - a t 2 Ki)(E -ar 2 A 2 ) y n = Ay + ip . 

Another way of proceeding is to reduce scheme (43) to 

(E- a t 2 A) y t = F , F = (E - a t 2 A) y T + r (A y + p). 

Having completed the factorization of the operator E — a r 2 A at the member 
y t so that 

(E - a t 2 Ai)(E - a t 2 A 2 ) y t = F , 


we deduce that 

(45) a 2 r 3 Ai A 2 yo + (E - a t 2 A + 0.5 a 2 T A A x A 2 ) y- it - A y + p . 

Both factorized schemes (44) and (45) generate second-order approxima¬ 
tions in r for any a and they are stable under the condition 4a > 1 + e, 

e > 0, since the operators R a = -A a are self-adjoint, positive and commu- 

0 

t.a.tive in the space El = fi of all grid functions given on the grid u> h and 
vanishing on t.he boundary j h of the grid. 

In an attempt to recover y = y 3 + 1 from the difference equations just, es¬ 
tablished, we shall need the boundary conditions for an intermediate value. 
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With this aim, the equation B\ B 2 't/p = A y can be solved in such a way 
that 


Bi w (1) = Ay + ip, u> w \ yh = B 2 Htt , x i = 0, /j, 

B 2 w ( 2) — w (l)> w (2) lo/j /Tt 1 x 2 ~ 0> ^2 > 

V 3 + l = 2 y> - ij~ l + t 2 lo (2) ■ 

In so doing three sequences of the values y 3 ~ l , y 3 and cu^ 2 ) are yet to be 
saved in the storage in the process of calculations of y 3 + 1 . One trick we have 
encountered is connected with a prior reduction of the preceding scheme to 


BiB 2 y t =$, $ = t (A y + y>) + B l B 2 y { , 

thereby increasing the total volume of computations, but saving only two 
sequences of the values y 3 and <^( 2 y 

The algorithm of solving equation (45) was demonstrated before and 
so it remains only to construct economical factorized schemes associated 
with problem (42) by means of the operator L a acting in accordance with 
the rule 


L a u — (jz a (x ) t) ^ , 0 <1 c i — c 2 ! 


du 


dx a V y dx a 

and adopt as a primary one in that case 

(E + t 2 R) ijf t = A y + ip , 

where 

2 


A y=Yl (“« y*J v > Ry=-vA y, A y = y SlXl + y X2X2 . 


a= 1 


The parameter <7 is so chosen as to satisfy the stability condition 


{Ry,y) > (~Ay,y), e>0, 


0 


0 


for any y G H = Q , where is the set of all functions given on the grid 
Co h and vanishing on the boundary y h of the grid. True, it is to be shown 
that the choice <7 = (1 + e)c 2 /A is sufficient for doing so. 
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Having replaced the operator E + r 2 (f?i + R^) by the factorized op¬ 
erator (E + t 2 R{) (E + r 2 f? 2 ), where R a y — —a y S x , a = 1,2, we obtain 
under such an approach the economical difference scheme 


{E + t 2 Ri) (E + r 2 f?2) Hit = A V + V, 
y l 7 =P, y(z,0) = U 0 (x) , y t (x,0) = u 0 (x) , 

with it 0 = u 0 + 0.5 t(Lu + /)| Q incorporated. This scheme is of second- 
order accuracy in r and |/i|. What is more, it is absolutely stable and 
appears preferable in practical implementations. 

5. Economical schemes for a system of equations of parabolic and hyperbolic 
types. Let G = {0 < x a < l a , or = 1,2,... ,p} be a parallelepiped in the 
space R p , 


Qt — G x [0 < t < T] , Qt = G x (0 < 1 < T] 

and k = (k a p) = (k^ 1 ), s,m = 1,2,... , n, be a matrix of size p x p with 
square blocks of size n x n satisfying the condition of symmetry 

(46) k*™(x,t) = k™*(x,t) for all (apt) e Qt 

as well as the condition of positive definiteness 

(47) lEE( 0 2 < E E ^(M)gc<bEE(C) 2 . 

5 — 1 01=1 5,771 = 1 a,{3= 1 5 = 1 or=l 


where c, and c 2 are positive constants and £ a = . .. , , . .. , is an 

arbitrary real vector. The positive definiteness of the matrix k is equivalent 
to being strongly elliptic, of the operator L with the values 

\^ ^ ( chi \ 

(48) L\i — / , L/yjj n , Ltyjj ri yk a ^{^Xy /) _ J , 

a,/3=l X ° X P 

where u = [u 1 , . . . , u s , . .. , u n ) is a vector of order n. The meaning of this 
property is that we should have 


(49) 


c, ( — L^u.u) < ( — Lu,u) 
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where 


( u ’ v ) = Y / uS i x ) vS i x ) dx > 

s = i 

r(0) a V- 92u 

L )u = Au =22 7 )^’ 


0 - = ! 


dx = dx x . . . dx p , 


and u is an arbitrary sufficiently smooth vector-function vanishing on the 
boundary F. 

The problem here consists of finding a continuous in Qx solution of 
the system of parabolic equations 

O 

(50) ^ = iu + f(i,f), (M)eQ T , 


u = fi(x, t ) for itT, t E [0, T ], 


u(i;, 0) = u 0 (:c) , x £ G. 

Before going further, it will be sensible to introduce in G a grid 

^h = i x i = (h h u ■ ■ ■ Gp h P ) 0 <i a <N a , h a = l a /N a , a = 1,2,... ,p} 

and on the segment 0 < t < T a grid ui T = {tj = jr, j = 0,1,...}. 
The operator L a g is approximated by the difference operator A a p acting 
in accordance with the rule 

( 51 ) A a/3 u = 0.5 [(k a gu s ) _ +{k af} u ) ] 

‘ & Ct G 3d (y 

with the well-established notation 

p 

(52) Au= ^ A a ^u. 

a,p=l 

Along these lines, we obtain for j3 = a 

Aacv u = (a a %-J^, a a = 0.5 ( k aa + . 

0 

The inner product in the space fi h of all grid vector-functions given on the 
grid u> h and vanishing on the boundary j h is defined by 

n 

(y,v) - ^2(y S ’V s ), (y*,v*) = Y y’(£)v*(x)lh---h r - 

5 — 1 x ^ u 'h 
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On the strength of (46) the operator A is self-adjoint, meaning 
(Ay, v) = (y, Av). 

From (47) we derive the inequalities 

(53) 0 (-A( 0) y,y) < (-Ay,y) < c 2 (-A(°)y,y) , y EQh, 
where 

A (0) y = 52 y SaXa , (-A (0) y,y) = 52 52 h (vUl • 

01=1 01 = 1 5 = 1 

As further developments occur, the operator 

p 

(54) R=52 R °’ A a y = -ay SaXa , a = l,2,...,p, 

01=1 

will be declared to be the regularizer R. Here <7 is a numerical parameter, 
the choice of which is stipulated by the stability criteria in the sequel. 

In view of this, a reasonable form of the primary two-layer economical 
scheme is 

(E + tR) y { = Ay + ip , 

where 

<p = f j + 0(\h \ 2 + r 2 ) . 

Upon replacing E + tR = E + t Yla =1 by the newly formed factorized 

operator 

p 

H(E + rR a ) = E + TR, 

0 = 1 

R — R + t Qp , Qp = 'y ' RaRp + ■ • ■ , 

a<p 

we are led by exactly the same reasoning as before to the economical fac¬ 
torized scheme 

p 

(55) P[ (£ , + ri?„)y i = Ay+<y5, x E w h , t E u> T , 

a~i 

y(x, t) = p(x, t) , xEj h , tEui T , 
y(x,0) = u 0 (x), xEQ h . 
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In what follows the computational algorithm capable of describing 
{E + t Ri) u> (1) = Ay + ip , 

P 

w (i) = II ( E + tR p)Ri for 

P=2 

(E+TR a )LO (a) =LO {a _ l} , a = 2, 3,... ,p , 

P 

V( a ) = (E + TRp)v t for x a = 0,l a , a= 2,3,... ,p- 1, 

}3zza +1 

will be performed for determination of a vector-function y J + 1 = y. Scheme 

(55) is absolutely stable for <7 < 0.5 c 2 and converges with the rate 0(t + 

|h| 2 ). 

The three-layer scheme 

(56) yo + t 2 R y h = A y + ip 

is of second-order accuracy in r, so there is some reason to be concerned 
about this. Rewrite it in the form 

(E + 2 t R) y t = F , F = 2(Ay-*>)-(£-2ri2)y ( 

with further replacement of the operator 

E + 2r R= E + 2t )T R a 

a= 1 

by the newly formed factorized operator 
p 

(E + 2 r R a ) = E + 2t R + 4 t 2 Q p . 

a —l 

By these changes we are led to the economical factorized scheme 

p 

H(E + 2rR a ) yi = F , 

a = l 


(57) 
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whose canonical form is 


(58) {E + 2 t 2 Q p )y° + t 2 (R+ tQ p ) y fi = Ay + ^ , 

y - H for x <Ey h , t <E Co T , 
y(*,0) = u 0 (x), y<(x,0) = u 0 (x), x£Q h , 

where u 0 (a;) = Lu 0 + f(a;,0). 

The following algorithm is performed for the recovery of y = y J + 
from scheme (58): 


{E + t Ri) wh. = F s , s = 1,2,... ,n, 


p 


w fD = II ^ + r h; for x i = 0, l i , 

/3 = 2 

(i? + r f? a ) = j q, = 2,3 , t p , s = 1 , 2,n , 


'(<*) 


jj (if + r Rp) fi s t for x a = 0,l a , a = 2, 3,... , p - 1 , 


P=a+ 1 


yj + 1 _ y j + rw (p) 


As can readily be observed, the components can be found inde¬ 
pendently. The primary scheme (56) becomes stable by merely setting 


c 2 (1 + e) , n 

a = —-, £ = const > 0 


The operators R a are positive and pairwise commutative, assuring us 

of the validity of the inequalities Q p > 0 and R > R, where R = R + tQ p 

is the regularize! of scheme (58). This supports the view that scheme (58) 

0 

is absolutely stable in the space fi/,. 

Let y be a solution of problem (58) and u be a solution of the original 
problem (50). Upon substituting y = z + u into (58) we establish for the 
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error the following conditions: 

(59) (E + 2 t Qp) Zo + t 2 (R + t Qp) Zff — A z + i/;, 

z = 0 for x G 7 /j, / £ d> T , z(x, 0) = 0 for x G u h , 
z ( (x, 0) = i/(x) for x E u> h , 

where 

(60) r/> = A u + — Uo — r 2 i? — 2 r 2 Q p u ( = r/> 0 — 2 r 2 Q p u ( , 

V’o is the error of approximation of the primary scheme (56) and 

V = u = u t = O(t) . 

Since B = E + 2r 2 Q p > id, Theorems 6 and 9 in Chapter 6, Section 3 are 
still valid for scheme (59), on account of which the error of approximation 
i/ to the second initial condition can be most readily evaluated in the norm 

\W\\ D > where 

(Du, u) = 7( Ru,u) + T 3 (Q p u, u) = 0(t 4 ) , 

0(r 2 ) , since u = O(t) . 

From (60) it is easily seen that tj) =■ 0 (t 2 + |/i| 2 ). The smoothness proper¬ 
ties due to which we would have = 0(t 2 + \h \ 2 ) and = 0(t 2 ) will 

become more stronger in connection with increasing the number of obser¬ 
vations p. These restrictions can be relaxed with the aid of the chain of the 
inequalities 

p 

2 r (rj>, zo) = 2 r 3 (Q p v, z„) = 2 r 3 (Q< 2 >v, z. ) + 2r 3 ^ r'- 2 (Q<*>v, z. ) 

s = 3 

< r || Zo || 2 + r 5 || Q( 2 )v || 2 + r S (Qi s) z, ^ ) + E ^(Q^v, v) 

5=3 5=3 

V 

< T (Bz t ,Za) + T 5 WQ’f'tvtf + T f+2 (Q^v,v), 

5=3 
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which are put together with a priori estimates for equation (59) with the 
right-hand side 


p 

ijj - r 2 Q p v - r 2 ^2 t s ~ 2 Q ( p s) v , v = u t . 

s = 2 

Two last summands in the preceding inequality are some quantities of 
0(r 5 ), so there is some reason to make their contributions to the accurate 
account of the accuracy z. Thus, scheme (58) converges in the grid space 

W 2 with the rate 0(r 2 + \h \ 2 ). 

The object of investigation is the system of hyperbolic equations 

<9 2 u P 

(61) ~ = Lu + f(x,t ), (x,t)eQ T , L= ^2 L »p , 

CX,P= 1 

with the supplementary conditions 


u ~ for ref, t G [0,T], 

( 6 2 ) a 

u(.-c, 0) = u 0 p) , — = u 0 (x) for x G G , 

under which it is required to find a continuous in the cylinder Qr solution. 
Here the operator L — YTa p=i is specified by formula (48). Observe 
that a system arising from elasticity theory such as 


a 2 u 

~W 


p A u + (A + fi) grad div u + f , 


v 

au = y, 

a = { 


<9 2 u 

dxi 


where A = const > 0 and p = const are Lame’s coefficients, u = (uCtr, 
. . . , u p ) is a vector-function of order p, can be viewed as one particular case 
of the system (61) for n = p and 


~ A 4 ^ aft Km + + A 4 ) @ &as&Pm + (1 ~ K & am&p s , 


r 1, i = 3 

1 o , i # 3 


Here 6 is an arbitrary constant. In this context, several things are worth 
noting. Condition (46) is automatically fulfilled. Condition (47) continues 
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to hold with constants c i = /.t and c 2 = A + 2/.t, when providing current 
manipulations: 

E E 

3,771=1 a,/3=l 

= 7 E (o 2 + (^ + 7) ^ E cc + (i-^) E cc ■ 

or, s = l L or,s=l Qr,5 = l 

Indeed, accepting here 0 = 1, we find that c, = /.t, since 

p 

J = E £«>£/?) 

Qf,rf= 1 

p / p \ 2 

= 7* E + fO I E ) 

cv = l \a = l / 

> 7 E Kcrl 2 - 

(7=1 

For 0 = 0 we are led to c 2 = A + 2 p by virtue of the relations 

J = 7 E l£«| 2 + + fO E CC 

or=l a,5 = 1 

< f* E u 2 + ^ E (o 2 + E (O 2 

or=l l_a,5 = l a,5 = l 

= 7Ek„| 2 + (A + 7)E(E(C) 2 ) 

a = I cv = 1 s = 1 

P 

= (A + 2 f.i) E l£«|7 
0=1 

Thus, c l — /i and c 2 = A + 2/.t, The same operator R will be adopted as a 
regularizer in the further development: 

p 

^ = E Ra ' R a y=-a- y SaXa ■ 

Qf=l 
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Observe that the primary scheme y ( - ( + T 2 Ry^ t — Ay + tp is stable 
under the restriction 

C, (1 + t) 

a = ~ v , -- , s = const > 0 . 

4 

By replacing 

v 

E+ t 2 R = E + R ° 

a= 1 

by the factorized operator 

p 

D= H(E + T 2 R a ) 

OC= 1 

we obtain the economical factorized scheme 

p 

ff i E + T 2 R a )yt t = Ay + p for x£u> h , t£u> T , 

a~ 1 

y = M for x£ j h , t£Co T , 
y(x,0) = u 0 (a;) , y t {x, 0) = u 0 (x) for x£Q hl 

where u 0 (x) = u 0 + 0.5 r (Au 0 + f(x, 0)). 

It is plain to show that the scheme concerned is absolutely stable and 
it generates an approximation of order 2: i/; = 0(r 2 + \h\ 2 ), is — 0 (t 2 ). 
Whence the convergence with the rate 0(t 2 + \h \ 2 ) immediately follows. 

The search for y J + 1 amounts to successive solution of three-point equa¬ 
tions of the form (E + t 2 R a )w = F„ by the elimination method for every 
component of the vector w with the index account from a to a + 1. One 
possible way of covering this is connected with the performance of the fol¬ 
lowing algorithm: 

v 

(E + r 2 i?ijw (1) = F , F = If (E + t 2 R a ) y ( - + r (A y + p) , 

a = 1 

(E + T J R a )w {a) - w ( „_ i} , 


a = 2,... ,p, y J + 1 = y J + rw fp) 
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which includes as part the supplementary boundary conditions for the 
vector-functions , cx — 1,2, . . . , p — 1, in the case x a = 0, l a : 

w (i) = i E + t 2 R 2 ) •••(£ + t 2 R p ) , x L - 0, /j , 

P 

W (a) = II ( E + T ' 2 R P)^t ’ *a = °> / a- 

P = a+l 


From here the components of the vector w^, a = 1,2,... ,p, can 
be recovered independently, since the operators D a = E + r 2 R a possess 
diagonal matrices of coefficients with diagonal blocks. 


9.3 THE SUMMARIZED* APPROXIMATION METHOD 

1. The problem statement. First of all, it should be noted that it is impos¬ 
sible to generalize directly the alternating direction method for three and 
more measurements as well as for parabolic equations of general form. Sec¬ 
ond, economical factorized schemes which have been under consideration in 
Section 2 of the present, chapter are quite applicable under the assumption 
that the argument x = (aq, x 2> . .. , x p ) varies within a parallelepiped. 

Because of this, there is a real need for designing the general method, 
by means of which economical schemes can be created for equations with 
variable and even discontinuous coefficients as well as for quasilinear non¬ 
stationary equations in complex domains of arbitrary shape and dimension. 
As a matter of experience, the universal tool in such obstacles is the method 
of summarized approximation, the framework of which will be explained a 
little later on the basis of the heat conduction equation in an arbitrary 
domain G of the dimension p with the boundary F 

du 

(1) —~Lu + f(x,t), x = (a:,, x 2 ,. .. , x p ) G G , t > 0, 

P 

Lu = L a U , L a U — 

a -1 

provided that the conditions hold: 

(2) u\ r = p(x,t), f>0, u(x, 0) = u 0 (x) , x G G. 


d 

dx r 


k a (x,t) 


du 

dx n 


> Cj > 0 : 


Editor's note: Summarized = summed. 
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The quasilinear heat conduction equation reproduces the case when k a = 
k a (x, t, u) and / = f(x, t, -u). 

Of course, the words “arbitrary domain” cannot be understood in a 
literal sense. Before giving further motivations, it is preassumed that the 
boundary T is smooth enough to ensure the existence of a smooth solution 
u = u(x,t) of the original problem (l)-(2). In the accurate account of 
the approximation error and accuracy we always take for granted that the 
solution of the original problem associated with the governing differential 
equation exists and possesses all necessary derivatives which do arise in the 
further development. 

A common algorithmic idea behind available economical methods is 
connected with further reduction of numerical solution of a multidimen¬ 
sional problem to the process of solving a few simpler problems. In order 
to understand the nature of this a little better, we focus the reader’s atten¬ 
tion on second-order equations of hyperbolic and parabolic types for which 
the “basic algebraic problem” is related to a three-point difference problem 
(a second-order difference equation). The three-point difference problem 
obtained through such an approximation can be solved by the elimination 
method and it can be treated, as a rule, as a difference approximation to 
the one-dimensional (in x a ) differential equation. Some consensus of opin¬ 
ion is to create on this basis a chain of simpler algorithms which constitute 
what is called an economical algorithm for complex problems. This idea 
lies in the origin and terminology of many economical methods available for 
solving multidimensional problems. Among them, the alternating direction 
method permits us to solve at every stage a one-dimensional problem along 
a fixed direction x a , the method of “fractional steps” necessitates placing 
in the storage intermediate (non-integer) values at every stage of a complex 
computational procedure, the method of separation of variables in a com¬ 
mon setting of the problem reduces to a number of particular simpler tasks, 
etc. All these terms reflect one of the real advantages and the essence of 
economical methods. 

However, throughout this book, the classification of difference meth¬ 
ods is mostly based on the origin of difference schemes rather than on a 
possible way of constructing them and a perfect tool for solving this or that 
difference scheme (equation). 

2. The notion of summarized approximation. In the preceding sections and 
chapters the basic fundamental property of difference schemes is to generate 
approximations on a solution to the governing differential equation. In what 
follows we get rid of the classical notion by introducing a more weaker 
condition of summarized approximation, expanding our possibilities and 
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leading to additive schemes. The describing schemes of this type will be 
studied in more detail in Section 10, but a great deal of work still needs 
to be done in adopting those ideas. It is worth mentioning here their main 
peculiarities: 

• the passage from the jth layer to the (j+l)th layer can be performed 
through the use of a sequence of the usual (two-point, three-point, 
etc.) schemes; 

• the error of approximation provided by an additive scheme is taken 
to be a sum of the residuals of all auxiliary schemes, that is, any 
such scheme generates a summarized approximation. 

In this regard, we should take into account that auxiliary schemes are 
not obliged to approximate the original problem; the approximation here 
is ensured by summarizing all the residuals obtained. 

In Chapter 2 we came across the necessity of generalizing the notion 
of approximation in the real .situations when a difference scheme cannot 
provide on the grid io h local approximations with a desired order in the 
norm of the space C, but it does the same in one of the negative norms, 
that is, in a certain sense of summarizing. 

Likewise, it may happen that a scheme on the grid u> T cannot, provide 
local approximations in t, but at the final stage the approximation will be 
achieved once we bring together the residuals over several time layers. The 
notion of summarized approximation needs certain clarification. It seems 
worthwhile giving simple examples. 

Example 1 The Cauchy problem, being the most familiar one, comes 
first: 

du 

— + a u = 0 , t > 0 , 'ti(O) = u 0 . 

Common practice involves for solving it the difference scheme 


.yi + i / 2 — yi 

(3)-b a x y 3 = 0 , 


y 3 +1 - y 3 + i / 2 


a 2 y 3 


7+1/2 


j =0,1,2. 


y = u 0 , a 1 + c/ 2 = a, 


which consists of two explicit schemes with residuals i/q and i h 2 , respectively. 
Within more compact notations 


V 


3 = z 3 + u 3 , y 3 + l l 2 = z 3 + i l 2 — u , u = 0.5 (u 3 + u 3+l ) 
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we find that 

0 + 1 / 2 _ z j 


a 1 z 3 = — </>( , 


■J + 1 7 ] + 1 / 2 


,J + l/2 _ _ h j 


where 


0i 


m j + 1 — id 


+ ajti J , -02 


id +1 — id id + id +1 


By substituting here the expressions 


u j + l = yf + l/2 + I yi + 1/2 + L. .jP + 1/2 + 0(r 3) 
2 8 


id = id + 1 / 2 -id + 1 / 2 H-id + 1 / 2 + 0(r 3 ) 

2 8 


7 + 1/2 /, , n r 1 ■ rfu - d U 

« J 7 = w(f, + 0.5 r , v = — , « = — 

J a/ dp 


we are led to 


J + l/2 


0 ! = (^it+cp!^ - 5 cpr it J + 1 / 2 + 0 (r 2 ) , 


/. \ i +1 / 2 9 

02 = ( i W + <V« ) + 0(r 2 ) 


Whence it follows that. 0j = 0(1), 0 2 = 0(1) and 0j +0 2 = 0(r), meaning 
that none of the auxiliary schemes concerned provides an approximation, 
but the triplex composition generates a summarized approximation of 0(r). 

Example 2 Of special interest is the heat conduction equation 


du 

dt 


— Lu . 


La = 


0 2 1 


0 < m < 1 , «(0, t) ~ u 1 (t), tt(l, t) — u 2 (t) . 


In dealing with the grid ui h = {ip = ih, i = 0,1,. .. , N, Nh — 1} and 
the operator Ait = u. Vx ~ Lit, it seems reasonable to employ the explicit 
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scheme on the odd layers and the implicit one on the even layers. The 
outcome of this is 


y 2j+l - y 2j 


2(1- a) A y 23 , 


y^j + 2 _ y2j + 1 


= 2crA y 2j+2 , j = 0,1,2,..., 


where <7 > 0 is an arbitrary parameter. In order to calculate the residuals 


u 23 + l -u 23 


— 2 (1 — cr) A u 2] , 0. 2 


u 2; + 2 _ u 2; + l 


- 2 <7 A u 2;+2 


we insert in them the expressions 


u 2j+2 - u 2j + l + tu 23 + 1 + 0.5 r 2 ii 2; + 1 + 0(t 3 ) , 
u 23 = « 2; + 1 — r n 2j + l + 0.5 r 2 ii 2; + 1 + 0(t 3 ) , 
Au = L u + 0(h 2 ), Lu = u , 


implying that 


•0i = 0 j + W* . 02 = 0 2 + V 2 . 0„ = + h2 ) > « = 12, 

0 j = ((2 cr — 1) u + (1.5 — 2 cr) r -ii) 2;+1 , 


0 2 = (—(2 a — 1) it + (0.5 — 2 cr) r it) 


■■\2j + i 


From such reasoning it seems clear that 0 ; = 0(1) and 0 2 — 0(1) for 
cr yl 0.5, but for any cr there is no doubt that 

0 = 0! + 02 = 0((<7 - 0.5) r + h 2 + T 2 ) . 

Collection of equations (4) permits us to eliminate the value y 3 + 1 , leaving 
us with the weighted scheme with step 2r: 


y 2j+2 - y 23 


= A ( cry 2]+2 + (1 - cr) y 23 ) , j = 0, 1,. .. 



596 Economical Difference Schemes for Multidimensional Problems 


An alternative form of writing includes the intermediate value yj + 1 / 2 and 
a smaller step r in two times: 


yj+l/2 _ yj 

T 


(1 - a) Ay>, 


yj + 1 — yj + 1 / 2 

T 


a Ay 2 +1 . 


Here the passage from the jth layer to the [j + 1)th layer is carried out in 
the following two steps: the first one involves the explicit scheme and the 
second one - the implicit scheme as suggested above. 

Of course, this example is not of global character and can serve mainly 
as an illustration of such theory. It should be noted that in the general case 
the elimination of intermediate values with further reduction to a scheme 
including the values of y only at integer steps may be impossible and even 
meaningless in the theoretical research. 

3. Reduction of a multidimensional problem to a chain of one-dimensional 
problems. The multiple equation we must solve is 


Bu 

(5) — ~ Lu + f(x,t), 0 <t<t 0 , 

u(x,0) = u 0 (x) , x = {x l ,x 2 , ... ,x p ), 

where L is a linear differential operator acting on u(x,i) as a function of 
x, x = (aq , x 2 ,... , x p ) is a point in the p-dimensional domain G with the 
boundary F, on which proper boundary conditions are imposed in one or 
another convenient way. That does not matter for us in subsequent discus¬ 
sions. An effective tool in designing economical methods is the accepted 
decomposition 

L — L\ + + ■ • ■ + Lp 

with simplified operators. For example, if Lti — A u and L a u = d^ujdx’ 1 . 
then L a is the operator of the second derivative with respect to the argu¬ 
ment x a (operator of one variable). 

Furthermore, to problem (5) there corresponds the first chain of “one¬ 
dimensional” equations by reducing either (5) or 

Bu 

Vu= -~Lu- f(x, t) = 0 


to 


/x 1 Bu 

/ a U —' 0 , P a U — — -7— ■ L a U / a 5 

z —^ p Bt 

or= 1 r 
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where f a (x,t), a = 1,2,... ,p, are arbitrary functions with the same smo¬ 
othness properties as the function f(x,t), satisfying, in addition, the nor¬ 
malization condition 

fi + fi + ' ' ' + fp — f ■ 

In working on the segment 0 < t < t 0 with an equidistant grid 

q t - {tj = i T , j - 0 , 1 , • • • Jo) 

with step r it seems reasonable to divide every interval into p parts by 
recording the points tj +a / p = tj + ar/p, a = 1,2,... ,p— 1. Half-intervals 
tj_l-( a _i)p < t < tj + a / p denoted by A a are made up, as usual, by those 
points. By successive solution of the equations starting from a = 1,2,... 

(6) 'Pa^(a) = 0, xeG, t£ A a , a =1,2 ,...,p, 

under the additional assumptions 


(7) u ('l)(‘ c ;0) U 0 (x), u (or)( a '! 1 )/p) V (a~ l)!*! ^j+(a~ l)/p) ’ 

a = 1 , 2 ,... ,p, 

we find the values v(x,tj) = v^{x,tj), j = 0,1,2,... J 0 , with further 
treatment as a solution of the problem concerned. For the sake of simplicity, 
it is supposed that we have on the boundary the homogeneous boundary 
condition of the first kind and this should confine no generality of further 
motivations. 

Every equation V a v a = 0 or 
1 dv, ^ 

(6') - = L a v (a) + f a , a = 1,2,... ,p , 

is replaced by the newly formed difference scheme in which du/dt and L a 
are approximated by the appropriate difference expressions of the general 
form on a. grid u> h with steps h 1 , h 2 ,... ,h p 

( 8 ) n«y (n . ) = 0, a = 1,2,... ,p. 

In the simplest case the resulting two-layer scheme is aimed at con¬ 
necting the values 

y (a) = y i + 0,lp and y (a ^ l) = y ]+ ^ /p . 
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For example, the weighted scheme 


yj + a lp — yJ + ( a ~ 1)/P 


= Ac, (« a t/ + alp + (1 - o yi + ^yf) + ^ + 


suits us for doing so. Here A a ~ L a and cr a is an arbitrary parameter. 

The governing equation V a v^ a ^ = 0 is approximated by scheme (8) in 
the usual sense so that 


(9) 


T t , = n„w >+“/p - {V a u) j+alp 


tends to zero in some suitable norm as r —»• 0 and h a —*■ 0. 

The difference equations (8) constitute what is called an additive 
scheme. Indeed, let ijj a = n a u ; + “' /p be the residuals of the same scheme 
(8) with the number a attached. 

Arranging ip a as a sum 

(io) = (r a uy +a/p + f a 

and taking into account that 

(■ r a u) j+a,p = (v a uy +1/2 + o(r), 


we deduce that 


A« - A a + Ac, - A „ = {V a u) J+l12 

and [| 0* || —»• 0 as r —>■ 0, h —>■ 0, where || • || is some suitable norm on 
the space of all grid functions given on the grid io h . It follows from the 
foregoing that 


^Aa = o ; ||AII= Yh A, 


0 as r —»• 0, \h\ —»• 0 , 


that is, 


scheme (8) generates a summarized approximation if either 
of the schemes (8) with the number a approximates the 
corresponding equation (6) in the usual sense. 
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As a matter of experience, the estimation of the nearness of a solution 
of the difference problem amounts to the proximity between a solution of 
the original problem (5) and a solution of the chain of problems (6)-(7). 
The main idea behind this approach is connected with the obvious relation 

\\y j -u j \\< II y j -^ a) || + \\v 3 (a) ~u j || . 

In addition to (6)-(7), the second chain of the equations 

( 11 ) ~~dt^ ~ ^" u (“) " 1 " ’ x £ G , tj < t < tj + l , 

under the additional conditions of conjugation complements subsequent 
studies 


( 12 ) 


V) (- r '*j) = )(x,t 3 + l ), 

V (i)( x ’ t j) = v {x,t 3 ) , 3 = 1,2,.. 


a = 2, 3,.. . , p , 

, u (1) (x,0) = u 0 (x) . 


The solution of this problem is the function v(x,t) = v^(x,t). 

In contrast to (6)—(7), every equation with the number a is solved 
here on the whole interval tj < t < t- + 1 . It is interesting to note that in 
some particular cases solutions of problem (6)-(7) and problem (11)—(12) 
will coincide. This is certainly true in the situation when both f a = 0 and 
L a are independent of t. 

Along these lines, both chains generate approximations on the solution 
u = u(x, t ) of the original problem (5). Indeed, it is straightforward to verify 
for problem (6)-(7) with the aid of the relation V a u — (' P a u)l + 1 / 2 + O(t) 
that 


Pa = <P a + P* a ’ Whei ' e */’ a = «) ; + 1/2 , 0* = O(t) , 

where if) a = V a u[x,t) is the residual for equation (6) with the number a. 
In view of this, it follows from the foregoing that 

P P P 

= °, ^ = c = °( r ) ; 

azz 1 or= 1 azz 1 


it being understood that the system (6)-(7) approximates equation (5) in 
a summarized sense. 
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Thus, the attainable summarized approximation of the additive sche¬ 
me (8) owes a debt to the simultaneous usual approximations and a sum¬ 
marized approximation. In accordance with what has been said above, 
equations (5) are approximated by the chain of the difference equations 
(6)-(7) in a summarized sense and every scheme (8) with the number a 
approximates the corresponding equation involved in collection (6) in the 
usual sense. 

All this enables us to obtain through such procedures a perfect approx¬ 
imation. Let us stress here that the summarized approximation is ensured 
by the following conditions: 

• the operator L is representable by a sum L = L\ + L 2 + • • • + T p ; 

• the right-hand side / contains exactly p functions such that / = 

/i +/? + ■''+ /p • 

These conditions will be relaxed once we consider 

p p 

Lu ~Y 1 L ° u - ’ f - = °( r ) ■ 

«=1 or=l 

If the operator L a includes the derivatives with respect to only one variable 
x a , we call it a one-dimensional operator and the equations V a v^ — 0 
refer,correspondingly, to equations of one variable. The additive scheme 
(8) is termed a locally one-dimensional scheme (LOS). 

Section 5 of the present chapter will be devoted to such schemes re¬ 
lating to the heat conduction equation. 

4. Examples of reduction of multidimensional problems to chains of one¬ 
dimensional ones. It is apparent from that discussion that some class of 
problems for which a solution of problem (6) or problem (11) coincides on 
the grid u> h with the exact solution of the multidimensional problem (5) 
plays an important role. 

Example 1 The Cauchy problem 
du 

— + a. -u(t) - 0, t> 0 , u(0) = u 0 , 

where a > 0, is good enough for the purposes of the present section. With 
the representation a = a 1 + a 2 in view, we may set up the problem 

~^p- + a 1 v (l) (t) = 0, t’ (1) (0 ) = u 0 , 0 <t<t\ 

dv (2) 

——— + a 2 V( 2 )(f) = 0 , 


»( 2 )(o) = »(i)(0, 0 
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where t* > 0 is an arbitrary number. By resolving these equations we 
obtain 


= u 0 exp( — cqt) and 

V)W = v (1) {t*)exp(-a 2 t) = u 0 exp (-ci 2 t - cqC) , 
yielding v 2 (t*) = u(t*). 

Example 2 Recall now the statement of the Cauchy problem for the 
transfer equation 


du 

~di 


L i u L 2 u — 0 , 


L n u — 


du 

dx n 


= 1 , 2 . 


—oo < x a < oo , t > 0 , u{x, 0) = n(x ), 


whose solution u(x,t) = fi(x 1 — t,x 2 — t) is a “travelling wave” if fi(x) is a 
twice differentiable function. Since the operators L\ and L 2 are commuting, 
it is plain to show that 


u(x,t*) = v {2) (x,t*) , 

where v^(x,t*) is a solution of the system of equations 
dv /1 \ di)( \\ 

~ 0 ■- 0 <t<t\ v (1) (x,0 ) = m(x), 

dv( 2 \ dv (21 

+ faT = °> 0<t<t*, V (2) {x,0) = v (1) {x,t*). 

Indeed, a solution to the first equation acquires the form 

Ci)(M) = ^{x 1 - t,x 2 ). 

On the other hand, we find from the second equation that 

R2)('R t) — fi(x 1 t , X 2 t) , 

implying that v^ 2 ){x,t*) = u(x,t*). 
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Example 3 We learn from Ladyzhenskaya (1968) that a solution of the 
Cauchy problem for the heat conduction equation 


du d 2 u 

(13) — (L\ + L’2 + L 3 ) if = 0 , La u = , a' = 1,2, 3 , 


< x a < 00 , t > 0 , u(x, 0) = u 0 (x) 


is given by the formula 
(14) u(x, t) = u(x l , x 2 , x 3 , t) 


/ / / ! *2 ! *3 ! C ! C ! C ! 0 (C J £2 > £3) ^£1 ^2 ^3 


— 00 —00 —00 


where G , (^ 1 , x 2 , x 3 \ , £ 2 , £ 3 , t) is a source function such that 


G( y x 1 , x 2 , x 3j £1 j £2> £3> 0 — G 0 (xj, ,t) G 0 (x 2 5 G) G 0 (x 3 , £ 3 , t), 

G 0 (a: a; e>C) = exp(-(a; a - £„) 2 /( 4 0)/(2 a/wT) , a = 1,2,3. 

Here G 0 (a; a ,£ a ,f) is a function of the heat source of the Cauchy problem 
associated with the one-dimensional heat conduction equation 


V) 


dt 


L a v (a) , t> 0, w (a) (x,0) given. 


The general methodology provides proper guidelines for the selection 
rules in studying one-dimensional heat conduction equations 


dv (l 


(i) _ 


dt 


= Li v 


1 CD : 


dv ( 2 ) _ T dv (3) _ T 

— 7~, — — -Lf 2 Vfo\ * —“— — 

at 

0 < t < t 


; (2)> -^-~ h 3 V (3) 


1 )( 2 ’> 0 ) = M 0 (.X-) , f’( 2 )(a:, 0 ) = U (lj (x,t*) , l’(3)(x,0) = l>(2)(x,t*) . 
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It is plain to derive for this chain oof the equations the following expressions: 

OO 

^(1 ) (*^ J 0 j Go( X l ’ £l 3 0 ^(1 )(£l > X 2 3 ^3 3 0) 3 

— OO 

OO 

^’(2) (^3 0 — ^ ^0 ( X 2 3 ^2 3 0 V (2) 3 ^23 ^33 0) d £ 2 j 

- OO 

OO 

^( 3 ) (^3 0 - j Gq{ X 3 3 ^3 3 0 ^( 3)(^1 3 ^23 ^3 3 0 ) ^3 * 


Upon substituting here 


^(l)(^l>^23^3o0) = 3 

^( 2 ) (■t’l j e j *3j o) — u (iii 2 -! j e> ^3 3 ) j 

V (3)i X l J a; 2! ^3 J 0) — V (2){ X 1 1 x 2 J e 3 ) 

we obtain formula (14) for f*) at moment t = f*, meaning 

t)(3)(x,3) = u(x,t*) for any t* > 0 . 

The property of this sort is an immediate implication of the repre¬ 
sentation G(x,£,t) = G , (x 1 ,x 2 ,x 3 ;^ 1 ,^ 2 ,^ 3 3) as a product of the functions 
of one variable of the special type Go{x a ,£ a ,t). The well-established rep¬ 
resentation of the source function is still valid for equation (13) with zero 
boundary conditions of the first kind u = 0 for x a = 0,/„, a = 1,2,3, re¬ 
lating to the boundary-value problems in the parallelepiped {0 < x a < l a , 
a = 1,2,3}. For this reason identity (14) is certainly true in that case. 

What is more, it seems clear from the preceding examples that. u^ p) 
coincides with u(x,t) at all nodal points. 

Among other things, Examples 2 and 3 show the ways of expanding 
some spatial process into a sequence of processes being one-dimensional 
ones and continuing along the coordinate axes. Following established prac¬ 
tice, the three-dimensional heat conduction problem in a space or a paral¬ 
lelepiped with the zero temperature on the lateral surface reduces on the 
same grounds to the model problem concerned. If the initial distribution of 
temperature is known at moment t = t 0 , then the heat conduction will be 
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possible at the same moment only along one direction aq without concern 
of others. At moment t = t 0 + At the same procedure works along one 
direction x 2 and at moment t = t 0 + 2 At - along another direction x 3 . As 
a final result we obtain at t = t 0 + 3 At the same temperature distribution 
as in the three-dimensional case at moment t = t 0 + At. As a matter of 
fact, this is a way of reducing the three-dimensional process to a sequence 
of one-dimensional ones of prolongations as well as of a real physical process 
in three times. 

Generally speaking, proper guidelines in such matters are not so obvi¬ 
ous as the users might expect. For example, in isotropic media the operator 
L a involved in (6') is taken to be 



In spite of the fact that v^(x,t*) does not coincide with u(x,t*), the 
asymptotics reveals itself as 

v (p )(x, t*) — u(x, t*) = 0(t*). 

5. A locally one-dimensional scheme (LOS) for the heat conduction equation 
in an arbitrary domain. The method of summarized approximation can 
find a wide range of application in designing economical additive schemes for 
parabolic equations in the domains of rather complicated configurations and 
shapes. More a detailed exploration is devoted to a locally one-dimensional 
problem for the heat conduction equation in a complex domain G = G+ F 
of the dimension p. Let x = (x 1 ,x 2 ,... ,x) be a point in the Euclidean 
space R p . 

The problem statement for the heat conduction equation in the cylin¬ 
der Q to = G x [0 < t < f 0 ] is 


f) “ 

(15) = Lu + f{x,t ), L=J2 L o, (M) e <2( 0 , 

a=l 

u| r = p(x, t) , t> 0, u(x,0) = u 0 (x), X eG. 

Here F is the boundary of the domain G an cl L is a second-order elliptic 
operator. For the sake of .simplicity we agree to consider L = A, that is, 
L a u = d 2 u/dx 2 , a = 1,2,... ,p (Laplace operator). Also, we take for 
granted that 
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• problem (15) has a unique sufficiently small solution; 

• the intersection of the domain G with any straight lines C a parallel 
to the axis Ox a may consist only of a finite number of intervals; 

• it is possible to compose in the domain G a connected grid ui h with 

steps h a , a = 1,2. p (for more detail see Chapter 6, Section 1). 

To make our exposition more transparent, it is supposed that the 
intersection of the domain G with the line G a is a. unique interval. 

Thus, the set ui h of all inner nodes contains the points x = (aq, x 2 , . .., 
x p ) G G of the intersection of the hyperplanes x a = i a h a , i a = 0, ±1, , 

a — 1,2,... , p ) while the set j h of all boundary nodes consists of the points 
of the intersection of the lines C a , a = 1, 2,.. . , p, passing through all inner 
nodes x G ui h) with the boundary F. 

Here we retain the same notations as was done in Chapter 6, Section 
1: j h a is the set of all boundary nodes in the direction x a ; y h is the set of 
all boundary nodes x G F; uj* a is the set of all near-boundary nodes in the 
direction x a ; ui* h is the set of all near-boundary nodes; ui** a is the set of all 
irregular nodes in the direction x a \ u>* h * is the set of all irregular nodes and 
ui tt is the set of all regular nodes. 

The difference approximation of the operator L a at a node x is con¬ 
structed on the pattern consisting of the three nodal points x, 

ad +I °d. In view of this, the difference operator A tv ~ L a is taken to be 

(16) A a y = y ga:Va = (yCT 1 -) __ 2 y + 1) 

1 a 

at the regular nodes and 


(17) 


J_ / y c+lo,) - y __ y-y ( 1 ° ) 
h a V h a h* a 

I 1 ( j/( + 1 “) - y y - y( _1 “) 


h.a, 


at the irregular nodes, where h* is the distance from an irregular node x 
to one of the boundary nodes: ,c 1 + 1q 1 or x^~ la K But it may happen that 
both nodes and x l -~ la \ which are neighboring to x G to* h a , belong 

to the boundary, that is, G 7 /> a . In that case 


(18) 


A a y = 


7 ( + lo i 


y y-y 




h* 

a — 
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where h* a± is the distance between x and ad ±: T) (/i* ± < h a ). The preceding 
expression for A a y is in common usage. If x is one of the regular nodes, 
then h* a± = h* a _ = h a , yielding formula (16). 

Observe that A a provides a second-order approximation at the regular 
nodes A a tt — L a u = 0(h 2 ), while A a u — L a tt = 0(1) at the irregular ones. 

The intuition suggests some things in an attempt to write down the 
locally one-dimensional (LOS) scheme in conformity with available con¬ 
structions of Section 3. In working on the segment 0 < t < t 0 we introduce 
a grid Q r = = jr , j — 0,1,... , j 0 } with step r = t 0 /j 0 and involve 

arbitrary functions f n subject to the normalization condition 


£/« = /■ 

a = 1 


In line with established practice we replace the governing multidimensional 
equation by the chain of the one-dimensional hea.t conduction equations 


(19) 


1 di 


O) 


p dt 

a= 1,2,... ,p 

with the supplementary conditions 


La 'l’(a) + fa f° r ^j+{ci-l)/p < ^ G G' + a/P : 


x £ G , 


(20) 'u , (r)(0) — u 0 (x) , v^ a ^(x, ^( Q _ j)(a;, tj+(a-i)/p) > 

cv = l,2,...,p, V( a j = p(x, t) for lefa, 

where t j+a/p = ( j + a/p) r. 

Here the boundary conditions for may be imposed only on some 
part L„ of the entire boundary F consisting of the points of the intersection 
of F with possible lines C a parallel to the axis Ox a and passing through 
any inner point x £ G. The nodal points x £ j h a belong to that part F„. 

If, for example, G = {0 < x < l a \ is a parallelepiped, then F„ com¬ 
prises the planes x a = 0 and x a = l a . 

Through the approximation of every heat conduction equation with 
number a on the half-interval tj + ^ a _ 1 y p < t < tj +a j p by the standard two- 
layer weighted scheme we arrive at the chain of p one-dimensional schemes 
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with arbitrary numbers a a : 


~ - y - - = A a (a a y 3+a / p + (1 - O yi+^)fP) + ^+*1?, 

a =1,2 itWfc. 

The describing scheme is termed LOS. In what follows we confine ourselves 
to the applications of purely implicit LOS’s with <j a = 1: 


( 21 ) 


yj+a/p __ yj + (a-l)/p 


A a y 3+a ' p + +^ n +a ' p , 


a — 1,2,. . . ,p , x £ ui h . 

In preparation for this, the preceeding is put together with the boundary 
condition 


(22) yi+°/r=ni +°l? for xe 7hi0l , j = 0,1,... , j 0 , 

a = 1, 2,... ,p, 

and the initial condition 

(23) y(x, 0) = u 0 (x) . 

As we will see a little later, the right-hand side <pA | "“/ p and the boundary 
value yl+ a /P | can be expressed through the functions f n (x, t) and p(x, t ) 
taken at arbitrary moments <* and i** from the segment [tj , f- +i ], so that 
yj+ajp _ / a (x,t*) and ^'+ q, /p = p(x,t**), thereby retaining the accuracy 
order. For the sake of definiteness, we accept 

<pl+ a/ P = f a (x,t j+05 ) , y 3+a,p = y{x,t j+a/p ) , a =1,2 

by regarding y 3 to the known values. The value j 3 + 1 can be found on 
every new layer from (21)—(22) by successive solution of p equations of the 
form (21) with the boundary conditions (22) in a step-by-step fashion for 
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a — 1,2,... , p. In determining yl+"/p we must solve the boundary-value 
problem 


(24) 


A t J^( p - CiJ +a ' p + A ia + l ^( p = 

yj+a/p _ yj+a/p for xe 7 


F a if +a l p for xeu> h , 
a = 1,2,... ,p, 


with varying subscripts only. The difference equation is written on the 
•segment A a £ C a with the endpoints belonging to the boundary j h a and 
it can be solved by the elimination method along all the segments A a for 
fixed a. For doing so our expenses are not considerable, since the number 
of arithmetic operations required at every node of the grid are 0(1) 
solely in connection with successive determination of the values y- 7 + 1 /p , 
yi+'i/v ^ . j yj+ a /p t , yi + 1 by setting a — 1,2,... ,p and changing the 

directions of the eliminations. Thus, the locally one-dimensional scheme 
(21)—(23) falls within the category of economical schemes. 

6. The error of approximation of a locally one-dimensional scheme. Upon 
raising the question regarding the error of approximation provided by one 
or another LOS it is straightforward to verify that every separate equation 
(21) with the number a does not approximate equation (15) in spite of the 
fact that the sum of the residuals «/’ = </h + Vh + ' ' ' + involved tends to 
0asr-*0 and |/i| —* 0. 

Let « = ii(x, t) be a. solution of problem (15) with the operator L a u = 
d 2 u/dx 2 a and yi+ a /p, a = 1 , 2 ,... ,p be a solution of problem (21)—(23). 
The accuracy of LOS is characterized, as usual, by the difference y 7 + 1 — 
iJ + 1 = z 3+1 . 

The intermediate values yi +a !p need to be compared with u ;+ “/ p = 
u(x,tj +a / p ) by making the choice 2 ;+ “/ p — yi+ a !p - u^ +a / p . Upon sub¬ 
stituting yi +a /p = z j+a / p + u 7 +“/p into equation (21) we may set up the 
problem for the error z 3+1 : 


(25) 


z j+ci/p _ z j+(ct-l)/p 


= A a z j+a / p +^ +a / p 


j = 0,1,... ,i 0 , a = 1,2,... ,p, 

z j+a/p _ 0 f or x £ J h _ z(,c, 0) = 0 . 


where 

(26) 


,1,3+a/p ^ Aa u j+a/p + ^j+a/p _ 


,J+ a /p _ u ;+(«-0/p 
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Further analysis relies on the quantity with omitted superscripts: 


(27) + 

A simple observation that 


1 duy + 1 / 2 

p dt ) 


in the case where 


p o 

E */’ « = 0 

a-} 


E fa = f 

a—l 


serves as a basis for the representation of rp a = 0d+“/p as a sum 

E = iE + E 


where 


a r a 1 r a , 

r a = (A„ u j+a/f - L a rh + 1 / 2 ) + - p a +l / 2 ) 

( u 3+»/p _ u j+{a-l)lp y fdu\3+llA 


p \dt 


From the very definition of A a and ip it follows that 


0* = 0(/i 2 + t) at the regular nodes, 
■0* = O(i) at the irregular nodes. 

Thus, we might have 

a=l or—1 


at the regular nodes, that is, LOS in question generates a summarized 
approximation of 0(r + |/i| 2 ) at the regular nodes of the grid ui h , while 
0 = 0(1) at the irregular nodes. 
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7. Stability of LOS. The main goal of stability consideration is to establish 
that the uniform convergence with the rate 0(t + \h\ 2 ) follows from a 
summarized approximation obtained. This can be done using the maximum 
principle and a priori estimates in the grid norm of the space C for a solution 
of problem (21)—(23) expressing the stability of the scheme concerned with 
respect to the initial data, the right-hand side and boundary conditions. 

Recall that in Chapter 4, Section 2 we have proved the maximum 
principle and derived a priori estimates for a solution to the grid equation 
of the general form 


(28) A(P)y(P)= B(P,Q)y(Q) + F(P) for 

Qeiii'(P) 

y(P) — M-P) for PCS, 

where P and Q are some nodes of a connected grid Cl + S and III'(P) is 
a neighborhood of the node P except the point P itself. The coefficients 
A(P) and B(P, Q) must satisfy the conditions 


(29) A{P)>0, B{P,Q)> 0 

D(P) = A(P) - Y, B(P,Q)> 0. 

Qeiii'(P) 

Applying theorems of Section 2, Chapter 4 to problem (21)—(23) yields 
the following result. 


Theorem 1 The locally one-dimensional scheme (21)—(23) is uniformly 
stable in the metric of the space C with respect to the initial data, the 
right-hand side and boundary conditions and a solution of problem (21)- 
(23) admits for any r and h the estimate 

(30) Hi/'Hc < lkl| c + max \\p(x,t')\\ 

0<r<jT ~ 


+ max 
0 <t‘<j: 


h 2 Mx,t>) 


j -1 
j‘ = 0 




+ a/p | 
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where 


_ ■ i , 

— L j +a/p 


‘PxA 1 = V 


— , n j' + a /P 


h = max h r 


| = max 11/1 , ||t/|| = max |t/| 


IMIc* - M ■ IMI = max M ■ 


,r£w 


To prove this assertion, we represent a solution of the problem con¬ 
cerned as a sum 

y = y + v + w , 


where y is a solution to homogeneous equations ( 21 ) with boundary and 
initial conditions (22)-(23) and v and w are solutions to nonhomogeneous 
equations ( 21 ) with the homogeneous boundary and initial conditions: 


(31) 


j+a/p _ ,.] +(«—!)/P 


= A a v j+a/p + !pj +alp , x 6 , 


J h 5 


(32) 


a = 1,2,... , p , v(x, 0) = 0 , v i+ a /p = 0 for x £ 7 ^, 
w j+a/p _ w j+(«-i)/p 


= A a v} j+a/p + <p* j+a/p , x £ 


“h 


a = 1 , 2 , .. . ,p , w(x, 0 ) = 0 , w i+ a !p = Q for x £ 7 


Here 9 ? a and 9 c* are specified by the formulas 


for a; e w ,, 
0 for a; £ w* 


0 

id O' 


for a; £ co , 
for a; £ w* , 


so that 

0 

id„ + <=^a for 

thereby clarifying that <£>* differs from zero only at the near-boundary 
nodes. 

For convenience in analysis, the grid co' is made up by 


u' T = {0 , t j+a/p = (j + a/p)r , j = 0 , 1 , 2 , . . . ,j 0 - 1 , a = 1 , 2 , . . . ,p} 
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containing not only the nodes tj = jr of the grid uj t , but also fictitious 
nodes tj +a / p , a = 1,2, . , p — 1. Let u/ be a set of the nodes of the grid 

uj' t , for which t > 0. Finally, let P(x,t'), where x £ u> h , t' £ u/, be a node 
of the (p + l)-dimensional grid Q = ui h x u/ ; S be the boundary of the grid 
£2 containing the nodes P(x,0) for x £ Q h and the nodes P(x,tj +a / p ) for 
tj+a/p £ and x £ 7/t,a f 01 ' a -U a = 1 , 2 ,... , p, j = 0 , 1 ,... , j 0 ; fi* be a 
set of the nodes P[x,tj +a j p ), where x £ ui* h a is a. near-boundary node in 
the direction x a of the grid Co h . 

With these, we proceed to the complete posing of problems related to 
y and w. The intention is to use the equation for y in the canonical form 
(25) in combination with expression (18) for the difference operator A a not 
only at the regular nodes, but also at the irregular nodes: 


(33) 


1 1/1 1 
r h a \ h* + h* _ 

u: a T a 


y] 


j+a/p _ 


h*. 


;_ P + a/p 

h„ +1 


+ 1 J+ a /p i I ,-,i+(«-i)/p 

+ h*_h a ^~ 1 + r y 

oc a 

where = y{x^ la \ ij +a / p ). From here it, seems clear that conditions 

(29) are satisfied and D(P) = 0. Because of this, Theorem 2 from Chap¬ 
ter 4, Section 2 asserts that for a solution to equation (33) the estimate is 
valid: 

max |p(.P)I < max |w(f-’)|. 

Pen+s 1 - p e s 1 v 1 

Taking into account that 


max \y(P)\ 
Pen+s v ; 


max \\y(x,t')\\ 
t‘£w' 


where ||p(k)|| c = max |i/(+)| 


x £“>, 


max \y(P)\ = max (max \\fi{x, t') u , i r0 |i c y , 

rt^ t etc' T 


where ||p(a:)|| c , = max \y(x)\, 




we eventually get 

(34) \\y jo \\ c < |K|| C + max ||p( + , C)|| c . • 

u<t SJo T * 
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With regard to problem (32) for w, it will be sensible to rewrite state¬ 
ment (32) in the canonical form (28) 


I + _L ( _J_ +_ w i+«/r - _ 1 _ u j+ a /i' 

r h a \h*+ h* _) /?* + /i a , + i 

a a -r cv J a 


+ — ^'+“/ p + - w i+(»-t)/p + ip*J+ a /p, 


a = 1 , 2 ,... , p , 


itP +a / p — o f or x g j h a i iv[x, 0 ) = 0 , 
meaning w = 0 on the boundary S of the grid fi: 

iu(P) = 0 for P E S . 

The right-hand side <p* differs from zero only at such nodes (x,t'), 
where x G co*. The trace of the homogeneous boundary condition w = 0 
should be clearly seen in 

D(P ) > min -- - — = — , where h = max h . 

« h + h„ h z a 

a a 

Applying Theorem 4 from Chapter 4, Section2 yields 

(35) max |j/(P)| < max ^ —- < max /i 2 ||<g*|| r ,, . 

si -(- t 1 e io P) 

In the estimation of the function e we write down equation (31) in the 
canonical form (28) by regarging P = x to nodal points of the p-dimeiisional 
grid ui h : 


1 i J_ (— _ L ,J+«/P _ ^ ,j+«/p 

r h a \h* + h* _) h* + h a *“ +1 


1 

+ ,« , 
K~ h a 


g' + o/P , rpj + a/p 
i a -1 1 " 1 a < 


jpj + a/p _ 


v j + (a-l)/p 


v j+a/p _ g f Q1 . x g j h ^ v (x, 0) = 0 
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In that case D(P) = 1/r and Theorem 3 in Chapter 4, Section 2 states 

that 

= T \\Fi+^\\ c 
c 

< \\ vjHa ~ i)/p \\c+T\\v j a +a/p \\ c - 

The first summation of (36) over a = 1,2,... ,p gives rise to the relation 


(36) 


C+“/CL < 


c — 






n 


ll^ +1 |lc<ll^llc + ^Ell^« + “ /P 

ct-1 


C > 


which rs followed upon summing up over j = 0 , 1 , 2 ,, . . . , j 0 — 1 by the 
estimate 


Jo -- 1 p 

(37) lk°ll c <£ \\k +a,p \\ c - 

j'=o q = i 

Estimate (30) for a solution of problem (21)—(23) is an immediate 
implication of the collection of relation (34), (35), (37) if we might invoke 
the arbitrariness in the choice of the number j 0 . 

8 . Uniform convergence of LOS. This type of situation is covered by the 
following assertion. 

Theorem 2 Let problem (15) possess a unique solution u = u(x,t) con¬ 
tinuous in Qtp and there exist continuous in Q to derivatives 

d 2 u d A u d 3 -u 8 2 f 

dt 2 ’ dx 2 dx 2 ’ dt dx 2 ’ dx 2 ’ ~ ’ ' - 1 ’ 

O' ;J O O 

Then scheme (21)—(23) converges uniformly with the rate 0(h 2 + r) (it is 
of first-order accuracy in r and of second-order accuracy in h), so that 

11 ^ - uj \\ c < M (h 2 + r), i = 1 , 2 ,... , 
where h = max h a , M = const > 0 is independent of r and h a . 

1 <o<p 
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Proof Let = z^ +a / p . As usual, we may attempt a solution z^ a ^ — 
V{a) ~ ui +a l p of problem (25) as a sum z^ — v^ a) + r ^ with i]^ a) still 
subject to the conditions 

(38) - =ip a for xEu h +y h « = 1,2,... , p, 

T 

vi x > 0) = 0. 

From here we deduce for j = 0 , 1,. . . , j 0 that 

0 0 0 

V J+1 - V(p) = rf + t{iP ! + ip 2 + ■ ■ ■+ iP p ) = rf = 0 , 
since rf — 0 . With regard to it is plain to show that 

0 0 0 0 0 
\a) = r (ip, + 02 + • • ■ + •'/’„) = -T {'4>a + l + • • - + ^p) ■ 

The function is yet to be recovered from the conditions 


(39) ^ ^ ^ = A n - x 6 Lo h , , a = 1,2,. .. , p , 

v { a ) = -Via) for x e 7ft,« , v(x, 0) = 0 , 
where ip a = + A„p (a) . 

A solution of problem (39) can readily be evaluated on account of 
Theorem 1 in Section 7 with v = 0 incorporated for t — 0, stating that 

(40) |H| C < .max . (h 2 ||^' + “^|| c . + \\if +ah \- ; ) 

0<j'+a fp<j 7 

+ X>E u j+a %- 

j 1 = 0 a = 1 

If there exist for a / /? the derivatives d 4 u/dx 2 a dx ^ continuous in the 
closed domain Qx, then at all the nodes x £ 

0 0 

A«??(„) = -t A a (ip a+1 + ■ ■ ■ + ip p ) = O(t) , 
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since the quantity 77 ^ is recovered from equation (38) everywhere on ui h + 
7 /j a . On the other hand, r/>* = 0{h 2 -\-t) at the regular nodes of the grid c o h 
and i/ 1 * = 0{h 2 a + T) at the irregular nodes. Therefore, /i 2 ||t/>|| c . = 0(h 2 + r) 
and 11-0| | o = 0(h 2 + r), so that estimate (40) in such a setting gives 

Hz'lie = IHIc ^ M ^ 2 + r ) - 

since rf = 0 for all j = 0, 1 , .. . , j 0 . 

Observe that the stability with respect to the right-hand side and 
boundary conditions implies that the moments t* and t** can be arbitrarily 
taken from the interval (tj,tj +1 ). 

9. LOS for equations with variable coefficients. One way of covering equa¬ 
tions with variable coefficients is connected with possible constructions of 
locally one-dimensional schemes and the main ideas adopted for problem 
(15). It sufficies to point out only the necessary changes in the formulas for 
the operators L a and A a , which will be used in the sequel, and then bear in 
mind that any locally one-dimensional scheme can always be written in the 
form (21)—(23). Several examples add interest and help in understanding. 

1) A linear equation of parabolic type. 

Let in the statement of problem (15) involves 



Minor changes in the complete posing of problem (21)—(23) are based on 
the formula for the difference operator A a acting in accordance with the 
rule 


A « 2 /(a) = , D<Cj< a Q . < c 2 , i=t J+1/2 . 

A second-order approximation provided by the difference operator A„ on a 
regular pattern 

A„ u - L a u = 0(h 2 a ) 

is ensured by a proper choice of the coefficient a a . This can be done using, 
for example, 


= * a (* ( -° 5o) .0 


jd °- 5 “) = (aq, . . . , ViTc - 0.5 h a , z a+1 , . .. ,x p ) 
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allowing Theorems 1-2 to hold. 

2) A quasilinear equation of parabolic type. 
The complete posing of problem (15) includes 


Two possible ways of approximating the operator L a 


> c 0 > 0 . 
are: 


a) 


A, 




,(x,t,0.b(;y {a) + y { {a) la) ))y s 


1 ~ t i+ 1/ = 


b ) = \ a a (t C 0.5 (y ( 


-I) + a —I) ) ) Vs c 


t -1. 


J + l/2 


In the first case a nonlinear equation is aimed at determining that 
can be solved by one or another iterative method. Every iteration can be 
found during the course of the elimination. 

In the second case we obtain a linear equation related to and then 
use the elimination method for solving it. The uniform convergence with 
the rate 0(t + h 2 ) takes place under the extra restrictions concerning the 
boundedness of the derivatives d 2 k a j'du 2 ) d 2 k a /dx a du, d 2 k a /dx 2 a . 

Locally one-dimensional schemes find a wide range of applications in 
solving the third boundary-value problem. If, for example, G is a rectangle 
of sides /j and l 2 or a “step-shaped” domain, then equations (21) should be 
written not only at the inner nodes of the grid, but also on the appropriate 
boundaries. When the boundary condition 'duj'dx^ = cr~u + i/[~^ is imposed 
on the side x 1 = 0 of the rectangle {0 < x a < l a , a = 1,2}, the main idea 
behind this approach is to write for a = 1 equations (21) at the node aq = 0 
as well. This can be clone by setting 


A 




y( 




y {i ) 


Vi = 


0.5 h, 


0.5 h | u.w/fcj 

assuring the uniform convergence of the describing locally one-dimensional 
scheme with the rate 0(t + \h\ 2 ). 


10. Additive schemes. The general formulations and statements. Consid¬ 
erable effort is devoted to a. discussion of additive schemes after introducing 
the notion of summarized approximation. With this aim, we recall the no¬ 
tion of the n-layer difference scheme as a difference equation with respect 
to t of order n — 1 with operator coefficients: 


n —1 

£ 


13 = 0 


Cp(t j )y(t j + l 


P T ) 




(n — 1) r < tj < t 0 , 
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where Cp are linear operators acting in a vector normed space Hh • We shall 
need yet n — 1 initial vectors t/(0) = y 0 , y(r) — y l , . . . , y((n — 2) r) = j/ n _ 2 
for its numerical solution. 

By the n-layer composite scheme of period m (of order m) we 
generally mean a system of differential equatioins with operator coefficients 

m n — 2 

( 41 ) Y y( l j +P r ) = Y y( l j ~ P T ) + /«(*;) > 

(3 = 1 13 = 0 


a = 1,2,, 171 , (n — 1) r < t ■ < t Q , 

with known initial values y(k r), k = 0, 1, .. . , n — 2. Here tj takes on the 
values 

tj = (n — 1) r + k m r , k = 0 , 1 ,..., 

and the total number of layers is equal to the amount of the initial condi¬ 
tions. 

With knowledge of the values fi = 0,1,... , n — 2, where f • = 

(m + n — 1) r, it is possible to find y(tj + mr) = yj +m in the process of 
solving a system of equations with the operator matrix C = (C a p) of size 
m x m. 

Several particular cases will be given special investigation. For m = 1 
the composite scheme (41) falls within the category of standard n-layer 
schemes. For n = 2 the describing scheme is termed a two-layer compos¬ 
ite scheme of period m 


(42) Yl C cl3( t 3 )y( t j +/ ?r ) = D a0 y{tj) +f Q (tj), 

h=i 

1 < a < m, y(0) = y 0 . 

If for the composite scheme (41) the error of approximation ip is adopted as 
a sum of the residuals ip a of separate equations, that is, V’ = Vh + • • • + V m , 
the composite scheme (41) is called an additive scheme. 

By replacing r by r/m scheme (42) admits an alternative form 


(42') 


Y C <*l3(tj) y{tj + P T / m ) = Da 0 y(tj ) + /„ (tj ) , 

,3m 


a = 1, 2,... , 


m. 
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A two-layer additive scheme can always be written in the canonical form 


43) 


B 


.j+a/m __ yj+(ot~l)/m 


+ Y, A aP 

[3 = 0 


y : 


+P/m 


a = 1 , 2 ,... , m , 

where B and A a p are some linear operators. It is straightforward to verify 
that all of the available economical methods with canonical form (43) can 
generate a summarized approximation. 

Furthermore, let u(t) £ Ho be an abstract function of the argument 
t £ [(Mo] with the values in a normed space Ho and u h = Vh u £ Hh be 
the projection of u onto Hh, 

j + a/m j+(a— l)/m m 

+ «) = <f> a ~B ^^- J2 Aa f j «ft +/3/m 

13=0 

is the residual for equation (43) with the number a and i£+"/ m = u(tj + 
ra/m). Assuming this to be the case, the sum 

m 

v(K) = Y +K.) 

cv = l 


is of our initial concern. 

By definition, the additive scheme (42) provides a summarized ap¬ 
proximation on a function u(t) £ Ho if 

max ||V’(ul)|| —>0 as r —»■ 0 , h —► 0 , 

o<j<j 0 11 ^ ^"(2*) 

where || • ||^ 2 ^ is some suitable norm on the space Hh. In conformity with 
Section 2 the additive scheme (42) is said to be economical if the operator 
(matrix) C is economical. That is to say, the work and storage necessary 
in the numerical solution of the system of operator equations 

m 

( 44 ) Y c ^y j+ ^ lm = < 

13 = 1 


require a minimal number (in some up-agreed sense) of arithmetical opera¬ 
tions, For example, it may be proportional to the dimension N of the space 
Hh (it is equal to the total number of the grid nodes c o h ). 
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If (C a p) = C- is a lower triangle matrix and all the operators C aa 
are invertible, then the procedure of solving equations (42') can be reduced 
to successive solution of the equations 

Ci i ?/ +1/m = Di n y ] + , 


a—l 

C a a y> +a/m = D a o yi - £ C a p + /' , a = 2, 3 

13 = 1 

Such a triangle additive scheme will be economical once we involve economi¬ 
cal diagonal operators C' aa , a = 1,2,.., , m. Economical schemes arising in 
practical implementations of multidimensional mathematical-physics prob¬ 
lems turn out to be triangle additive schemes (usually lower, but sometimes 
upper), whose matrices are of a special structure. As a rule, nonzero ele¬ 
ments of the matrix (C a p) stand only on one or two diagonals adjacent to 
the main diagonal. With this in mind, the scheme 

Caa y J+a/m + Caa-i V 3+(a ~ 1)/m = D a0 lj ] + P a , a = 1,2, . . . , m , 

may be of assistance in achieving the final aims. In particular, when D a o = 
0 for all the values a = 1,2,... , m, the preceding reduces to 

c aa y j+a/m + Caa-l = fi , 


one special case of which is the weighted scheme 


j+a/m _ yj+(ot-l)/m 


+ Aa (cr a y 1+a/m + (1 - o y 1 '^ 


Such locally one-dimensional schemes were investigated before, all the triks 
and turns remain here unchanged. The following issues are yet to be an¬ 
swered in the possible theory: 

1) the estimation of stability and accuracy of an additive scheme; 

2) the design of an economical additive scheme for a multidimensional 
problem in mathematical physics. 


11. Methods for the convergence rates of additive schemes. So far we have 
established many times that approximation and stability of a difference 
scheme provide its convergence. For additive schemes we shall need stability 
with respect to the right-hand side so that it follows from the condition of 
summarized approximation 




0 
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that a solution of the relevant difference problem supplied by the zero initial 
condition approaches zero. Such a priori estimates hinging on the summa¬ 
rized approximation properties hold true for additive schemes associated 
with systems of parabolic and hyperbolic equations. 

We outline in what follows the general theory for an additive typical 
scheme in a Hilbert space Iih such as 


(45) 


B 


z j+a/p __ j+(a-l)/p 


+ I> 

13=1 


Q p B+P/r = ^ 


a - 1,2,. . . ,p, j -r 0, 1, .. 


.,0 


0 . 


Theorem 3 If B — B* is a positive definite constant operator and the 
matrix-operator A is non-negative A = (A a p) > 0, that is, for any vectors 

L. t/3 e h 

P 

(46) E (A a ^ a ,^)>0, 

&,p—l 


then a solution of problem (45) satisfies the a priori estimate 

+ pv^ i j 12 ik*ii B -i }■ 

B-i a=l J 

The proof of this formula is omitted here. It should be noted that from 
such reasoning it seems clear that due to the summarized approximation 
in the space H B - 1 the convergence occurs in the space Hg. That is to say, 
the conditions 


(47) 


< max 
~ 0 <k<j 


Ed 

CX— 1 


(48) 



B- 1 


p\\ B -r=0(l), r-0,|fch0 


guarantee the convergence ||E|| B —>■ 0 for all j = 1,2,.., by observing 
that estimate (47) is valid under rather mild conditions: B is a positive 
definite self-adjoint operator and A is a non-negative matrix-operator. But 
in a Banach space Hh another method of further derivation of a priori 
estimates is employed for scheme (45), 

In what follows scheme (45) is supposed to be stable so that 


< M max 
0<^<j 


Endibv 


(49) 
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where || • and || • ||^j are some suitable norms on the space H^. The 
usual trick we have encountered is to represent the residual ip a by 

p 

(50) V , a = V , a+C> SO that = 

O '—1 

By setting E + "/ p = ? f +a l p -f v J+ a /p i where ? f +a / p is determined from the 
conditions 


B 


jjj + O'/p _ i)/p 


ipi , a = 1, 2 ,p, rj - 0 


it is plain to show that 

O' 

B rf +a/p = B ,f + r J2 'I’i > B 1 l j+V = B 7] j = ■ ■ • = B if = 0 , 

3=1 

giving if — 0 and — v 3 ' for all j ~ 1,2,... and 

a p 

rf +a 'P = T B- 1 1/ =~r J2 B ~ l H’ a =1.2,... >P -l. 

/3 = 1 /3 = a + l 


In turn, vi +a l p satisfies equation (45) with the right-hand side 


= V’o 


+ T A a P 
13^1 


t wj 

/3'=/3 + l 


and the initial condition v° — 0. Having stipulated condition (49), the 
following estimate is valid: 


IE 


(i) “ 


O) 


< M 


max 


E "'bib)- 


The reader is invited to prove this assertion on his/her own. The summa¬ 
rized approximation condition means that 

1) the residual admits representation (50), 

2) ||'/ 3 l( 2 ) —^ 0 as 7" —^ U and \h\ —> 0. 
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The second condition is ensured if 

11 ^* 11 ( 2 ) —" 0 > \\A afj B- l ^ s \\ = 0(l) as r^OjAhO. 

The second method of special investigations with concern of additive 
schemes was demonstrated in Section 8 in which convergence in the space 
C of a locally one-dimensional scheme associated with the heat conduction 
equation wa.s established by means of this method. Let us stress that in such 
an analysis we assume, as usual, the existence, uniqueness and a sufficient 
smoothness of a solution of the original multidimensional problem under 
consideration. 

Let, for example, u be a solution of problem (5) and y = y h be a 
solution provided by this or that additive scheme, y h £ Hh, where Hh is 
the set of grid functions. Following established practice, the difference z ] h — 
iffo—Ufo, where u h = Vh u and Vh is a linear operator from the space Hq into 
the space Hh (u 6 H 0 , u h 6 Hh), needs investigation. To be more specific, 
we are interested in the possible estimates of the quantity ||j/^ — 
in some suitable norm || • on the space Hh. The traditional ways of 

covering this are to set up the relevant problem for the error z h , calculate the 
o 

residual ip a = ip a + tp* and then adapt one of the well-developed methods 
for determination of z h . 

12. An approximation of the “multidimensional” abstract Cauchy problem 
by a chain of the “one-dimensional” Cauchy problems. It is to be hoped 
that the forthcoming reduction helps clarify what is done. The problem 
statement involves problem (5) with the homogeneous boundary conditions 
on the boundary V under the agreement that the function u(x,t) as a 
function of the argument x can be treated in a common setting as an element 
of some vector normed space Ho. Then L refers to a linear operator in that 
space and u — u(t) may be viewed as an abstract function of the argument 
t with the values H o, it being understood that u(t) £ Ho for all t £ [0,i o ], 
In this view, it is possible to write in problem (5) the usual derivative in t 
in place of the partial derivative, making our exposition more transparent. 
As a final result we get the abstract Cauchy problem 

du 

(51) —+Au = f(t), 0<t<t o , u(0) = u 0 £ H 0 , 

where A is a linear operator in the Banach space H ». The domain T>(A) C 
Ho of the operator A is everywhere dense in the space Hq and comprises 
all the functions satisfying the homogeneous boundary conditions on the 
boundary T and its range A(£l) belongs to the space Hq. 
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Also, the operator A will be taken to be 

(52) A = £ A a , 

a=l 

where linear operators A a are so chosen as to provide the relation 

p 

H V(A a )=V(A), 

1 

making it possible to reduce the solution of the Cauchy problem (51) to 
solving successively the Cauchy problems of the same type, but with oper¬ 
ators A a standing in place of the operator A. We confine ourselves here to 
two possible ways of such a reduction. 

For later use, it will be sensible to introduce on the segment 0 < t < t 0 
a grid ui T = {£• = jr, j = 0, 1, . . . , j 0 } with step r and to attempt the 
function / in the form 

v 

f = £ fa- 
a 

The first reduction (for more detail see Section 3). The object of 
investigation is a chain of the equations 

1 d v (ot) 

(53) - + Aa V (a) - f a , a = 1,2,... ,p, 

C + (a-i)/p < ^ ^j + a/p ’ 

with the supplementary initial conditions 

(54) v w (Q ) = u 0 , w (i) CP = , j = 1,2,... , 

~~ ^(<i~l)(^J+(a~l)/p) ) 

j = 0,1,. .. , a = 2, 3,... ,p. 

The function v(tj +1 ) = v^(tj +1 ) refers to a solution of this problem 
for t = tj_ |_j. In the general case we might have 


|| v{tj) - u(tj) || = 0{t) for all j- 1,2,... 
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The second reduction of the Cauchy problem. On the whole segment 
tj < t < tj +1 we must solve sequentially p Cauchy problems 

dv n \ 

(55) + Ai(t) = ,f\(t ), t 3 <t< t ]+1 , 


P + Adt) V {a) (t) = f a (t) , tj<t< t j + 1 , 


dv ( , 

~~~ + A p {t) v [p) (t) = f p {t ), tj<t< t j + l 
with the initial data 


v (t)(°) = : 'CoOy') = w ( P )(*j) - i = 1 , 2 ,.., , 

(56) 

By definition, an element 


v(t j + 1 ) - + , j = 0 , 1 , 2 ,... , 

gives a solution of problem (55) for t = f - +1 . For t = 0 we agree to consider 
(57) u n) (0) = «( 0 ) = « 0 , 

Knowing •), it is possible to determine )(ij + 1 ) from the first equation 
entering the above collection with )(tj) = v (tj) incorporated. At the next 
stage V( 1 -)(tj + l ) is taken as the initial value of v^ 2 )(t) for t — tj, allowing 
to solve the second equation for a = 2, etc. The outcome of solving all 
the p problems is w ( p )(^j+i) = v (tj + i), giving a solution of the system of 
equations (55)-(57) for t = tj + j. 

When the operators A a happen to be independent of t and / = 0, 
problems (53)—(54) and (55)—(57) become equivalent. With this in mind, 
we are going to show that problem (51) is approximated by problem (55)- 
(56) in a summarized sense. To that end, the differences 


2 (a)(f) “ v (a)(t) u (tj + l) f° 1- a “ 2, 3, . , . , p , t (z[tj,tj + j] , 


Z {1 )(t) ~ v (l)(t) ~ u (t) f° r tE[tj,tj + j] 
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will be given special investigation, where u(t) is a solution of the Cauchy 
problem (51) and u (Q .-,(i), a = 1,2,... ,p, is a solution of problem (55)- 
(56). By substituting here v^(t) = 2 (a )(0 + u J+1 , ii 3 + l = u(^ + 1 ), a = 
2,3,... ,p and = Zj(i) + u(t) into (55)—(56) we are led to 

~~+A a (t)v {a) (t) = ip a (t) , tj<t<t j + 1 , 1 <a<p, 

z {i )(*>) = z (p)(*;)> i = 1 , 2 > • • ■ > *5(0) = 0, 

z (a) (tj ) 1 )(^j + 1 )> i 0,1,..., a — 2, 3,... , p, 

z (^' + l) = z (p)(^j + l) > 

where 

lUO = ~A,(0 « J + 1 + / tt (0 , « = 2, 3,... ,p , 

du 

M*) = -A!{t)u{t) - — + £(*), i£ [IjCj + i] • 

From such reasoning it seems clear that 
'Ip = '0j(t) + ■ • ■ + lp p (t) 

= f(t) - ^ - di(t)u(t) - ^ .4«(t)i/ J + 1 . 

a = 2 

With the aid of the relations u 3 + l = u(t)+0(r), valid for any a — 2, 3,... ,p 
on the whole segment t £ [tj,tj + i], we finally get 

0 0 /7-m 

VC = ^ a + C ■ C=°( r )- 'i’o, = /<*(*) -A a (t)u(t) - 6 a y — , 

where j is, as usual, Kronecker’s delta. By the same token, 

E^ = E/u<)-E>i.(i)»(o-^ = o, 

O' — 1 Cf — 1 O' — 1 

V’ = S ^ = °( r ) • 

O'—1 


yielding 
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This means that the system of differential equations (55)—(56) generates 
an approximation of order 1 in a summarized sense to the Cauchy problem 
(51) under the extra restrictions on the existence and boundedness of the 
derivative A(t)d 2 u/dt 2 in some suitable norm. 

Further comparison of the solution v(tj ) of problem (55)-(57) with the 
solution u(tj) of the original problem allows to cite without proofs several 
interesting remarks. 

a) Let / = 0 and all the functions f a = 0. If constant operators hl a 
are pairwise commutative: A a Ag — ApA a , cv, /3 = 1,2,... ,p, then for any 
r the equality holds: 

(58) v(t j ) = u(t j ) for all j = 0,1,. .. , j 0 , 

where v is a solution of problem (55)—(57) and u is a solution of problem 
(51). 

When the operators A a = A a {t) happen to be dependent on the time 
t, equality (58) is still valid for commutative operators A a (t') and Ap(t”), 
a y! j3, taken at different moments t' y! t" } so that 

A a (t')Ap(t") = Ap(t")A a (t'), a, /? = 1,2,... ,p, 

for any t', t" 6 [0, t 0 ]. 

In this regard, we refer the readers to a few examples of Section 4 in 
which equality (58) holds true for commutative operators A a Ag = Ag A a . 

b) If the operators A a (t) and Ap(t) are non-commutative, then esti¬ 
mate 

(59) IK*,-)-«(*;) II = 0(r), j= 1 , 2 ,..., 

will be valid under the additional condition of smoothness: 

\\A a Apu\\<M, a , jd — 1,2,... ,p. 

Is it possible or not to improve the accuracy in r without essential 
modifications of the composite Cauchy problem? In an attempt to give 
a definite answer to this question, the composite Cauchy problem (55) is 
designated by the symbolism 

A\ —* A 2 —* ■ ■ • —* A p . 

The symmetrized problem consists of 2 p Cauchy problems such as 

0.5 hi 1 —► 0,5hl2 —►-► 0.5 A p 

—► 0.5 A p —► 0.5hlp_i —>-- 0.5 A\ . 
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This chain can be associated with the representation of the operator A as 
a sum 


JA, f 0.5 A a for 1 < a < p , 

A = V A' , where A'={ ~ ~ 

[0.5A 2p -a+i for p < a < 2p . 

The problem we have posed above is of second-order accuracy in r: 

|| A — || = 0 ( t 2 ) , 

provided that some smoothness property of the initial vector u Q of the type 


\\-AiA/ 3 U 0 \\<M, a, ,8 = 1,2,... ,p, 
holds together with the smoothness property of the operators A a {t) in C 
In such a way, the procedure of solving problem (51) reduces to a 
sequence of simpler problems (55)-(57), whose solution can be obtained by 
means of exact or approximate methods. In particular, the finite difference 
method suits us perfectly for doing so. If the operators A a are pairwise 
commutative, the accuracy of an approximate method available for solv¬ 
ing problem (51) depends oil how well we are able to solve every auxiliary 
problem with the number a from sequence (55). The above exploration is 
still valid for the case of the homogeneous boundary conditions. In dealing 
with the nonhomogeneous boundary conditions the accuracy of the com¬ 
posite Cauchy problem (55)-(57) depends significantly on the possible ways 
of specifying the boundary conditions for V( a ). The same remark applies 
equally well to difference analogs of problem (55)~(57), 

The difference approximation of every auxiliary problem from collec¬ 
tion (55) through the use fo the simplest two-layer scheme with weights 
leads to an additive scheme. If either of the auxiliary schemes with the 
number a is economical, then so is the resulting difference scheme. 


Remark The accurate account of error z h = y h — u h can be done in 
a number of different ways. In concluding Section 11 the usual way of 
proper evaluation of the error z h was recommended for an additive scheme. 
Another way of proceeding is connected with the triangle inequality 

II z h II — II Vh ~ u h II < II Vh ~ v h II + II v h ~ u h II > 

where v is a solution of the locally one-dimensional problem (53)-(54) or 
(55)-(57). From such reasoning ir seems clear that the further estimation 
of the error z h amounts to evaluating the proximity between y h and v h , v h 
and u h . Some progress in such matters can be achieved by the subsidiary 
information about the smoothness of the functions u and v, thus causing 
some cumbersome exposition in connection with more a detailed exploration 
of the properties of the solution v of the composite Cauchy problem (53)- 
(54) or (55)-(57). 
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13. Alternating direction methods as additive schemes. The starting point 
for special investigations is the alternating direction method developed in 
Section 1; 


•(/J +1/2 __ yj . 

--- - 0.5(Aird +1/2 +A 2 jd) + 0.5^, 


•(/J +1 _ j/J +1/2 

----= 0.5 (Ai y> +1/2 + A 2 y J+1 ) + 0.5 <pA 

T 

As can readily be observed, this system of equations is equivalent to 


y j+1/4 - y j 


0.5 A 2 y 1 +0.5^', 


j +1/2 _ . wj + 1/4 

y - - y - -= 0.5A 1 ^+ 1 / 2 , 


yj +3/4 _ yj + 1/2 


0-5 Aj t/ +1/2 , 


yj + 1 __ yj +3/4 


0.5 A 2 y +1 + 0.5 , 


relating to locally one-dimensional schemes. Both intermediate values 
yj +1 / 4 and yj +3 / 4 can be eliminated in the usual way without any difficul¬ 
ties. It is straightforward to verify that scheme (61) generates a summarized 
approximation such that. 

V 1 = Vh + i , 2 + V*3 + Vd = 0{t 2 + |/i| 2 ) . 

The alternating direction scheme ascribed to Duglas and Rachford 
and associated with the difference operator A a y = Vx x comes second: 


y i+l/2 - V j 


Ar y j+1/2 + A 2 •;/ , 


yj + i _ yi + i/2 


A 2 (y J+1 - y 3 ) 


Simple algebra gives the residuals 

a w + u » « — u d — u 

■>P i = Ai —-h A 2 m. ---, Vh = A 2 (u - u) ---, 

tL T L T 
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where u = u 3 and u = u 3+l . From here another conclusion can be drawn 
that dh =0(1) and ip 2 = 0(1), but 

tp = tp 1 + tp 2 = 0(\h \ 2 + r 2 ) , 

thereby clarifying a summarized approximation provided by scheme (62). 
Upon eliminating the intermediate value y 3+1 / 2 we have at our disposal the 
factorized scheme containing the values y 3 and y 3+1 and approximating the 
heat conduction equation to 0(r + |/i| 2 ) in the usual sense. But this scheme 
is stable only for commutative operators Ai and A 2 - No restrictions of this 
sort is made for the additive scheme concerned. 

14. LOS for a multidimensional hyperbolic equation of second order. The 

method of summarized approximation offers more advantages in design¬ 
ing absolutely stable and convergent locally one-dimensional schemes for 
equations of hyperbolic type. The object of investigation is the equation 

( 63 ) ^ = Y^ L « u + f( x ’ t )’ L « u = ’ 

a = l a a 

k a (x, t) > c 2 > 0 , c 1 = const , 

where x = (aq,... , x p ) £ R p and G is an arbitrary domain in the space R p 
with the boundary T, G = G + F and 


Qt = G x [0 < t < T], Qx — G x (0 < t < T\. 

The problem statement here consists of finding a continuous in the cylinder 
Qt solution to equation (63) satisfying the boundary condition 

(64) u = y(x,t) for x 6 T , 0 < t < T, 

and the initial conditions 

(65) u(x, 0) = u 0 (x) , -—^—- = u 0 (x) for x 6 G. 

As usual, it is preassumed in a common setting that the problem 
concerned is uniquely solvable and its solution u = u(x,t) possesses all 
necessary derivatives which do arise in all that follows. The domain of 
interest G is still subject to the same conditions as we imposed in Section 5 
for parabolic equations. Also, let lo t — {t- — jj , j = 0, 1,.. . } be a uniform 
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grid in r on the segment 0 < t < T and a grid ui h in G remains unchanged 
(for more detail see Chapter 5). 

If G is a parallelepiped in the space R p , problem (63)—(65) can be 
solved through the use of an economical factorized scheme with accuracy 
0(t 2 + |/i| 2 ), The design of such a scheme was made in Section 2 and it 
was investigated there in full details. Applying the same procedure serves 
ti motivate that, first, the operators 

l d~'u 

(66) V a u= -^j-(L a u + f a ), a = 1,2,,,, , p, 

p oV 

with f a still subject the normalization condition 

p 

E fa = f 

a = l 


are approximated successively with step r/p. 
Second, the difference expresions 


(67) 


l (a) ~ 2 U( a -1) + 


t a t a 


d 2 u 

dt 2 


j+(a-l)/p 


are aimed at approximating to the derivative & 2 u/dt 2 with step r/p, where 


l (a) 


,p+ a / 2 


( 68 ) 


W(«) = u 3 1+a/2 , WfO) = « = U 1 . U (2) = U . 

U (a) ~ U (a-l) — u (a- 2) + «(<*) 2 8 2 U 

E 9 dt 2 ’ 


a- = 1,2,3 for p — 3 , 


with the members = U( 2 ) = iE _1 )+ 2 / 3 anc j u ^ = “(l) = E -2 / 3 . 

Third, the operator L a u + f a is approximated to second order by the 
homogeneous difference operator A a y + <p a on the grid u> h in the space R p , 
The coefficients at the member A„ and the righ-hand side <p a are taken at 
the moment 


E “ ^-5 (tj + a/p + tj-l + a/p) ~ tj+a/p- 0.5 — tj + ( a /P ~ 0-5) r i 


so that A a = A a (t' a ) and ip a = p a (x,t' a )- 
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“Locally one-dimensional” schemes for hyperbolic equations acquires 
the form 


( 69 ) Vtctc = a P A <y(y(a) + y{a)) + 2cr p fa > a=l,...,p, p = 2, 3 , 

where 

f 1/4 for p = 2, 
ffp ~ 1 1/3 for p=3, 

and the left-hand side yf 4 ~ is given by formula (67) for p = 2 and by 
formula (68) for p = 3. With the detailed forms in mind, the final schemes 
refer to three-point additive ones (p = 2) and four-point ones (p = 3). 
The principal difference from the case of parabolic equations lies in the 
dependence on the number of measurements p. 

Equation (69) can be rewritten as 

(70) (E — cr p T-A a ) (y^ a ) + /(a)) 


^V(a~ i) + 2<r 2 rV a for p = 2, 

V( a -1) +V(a-2)) + 2o- 3 rVa fo l' P = 3. 


The solution is sought from the three-point equation 


(E - cr p T 2 A a ) y^ a) = F a 

along segments parallel to the axis Ox a with the boundary condition 


(fo) ?/(«) = K x ^j+a/p) for x &7h 

with further reference to the elimination method. 

First of the initial conditions u(x, 0) = u 0 (x - ) is approximated exactly: 

(72) KM) = u o( x )- 

The intermediate values y 1 / 2 = y(x,r/ 2) for p — 2 and y J / 3 = p(a;, r/3), 
y2/3 _ y( X; 2r/3) for p = 3 are found, respectively, from the equations 


(e- = Fi> 

F\ = u 0 + — u 0 + — Ai u 0 + t 2 — - (A m + /) j 


i = 0 


( 73 ) 
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if p = 2 or 

(74) (if- y Al )^ 3 = Fi, 

(if-^A 2 )(y 2 / 3 + Uo ) = 2y 1 /3 + ^ 2j 

= M o + g + 7-2 Ai m 0 + r 2 (- /, — - (A m + / )) 4 _ o ) 

^ 2 = r 2 (^/ 2 -i(A M + /)) i=o if P =3. 

We are now interested in the more detailed designs of LOS for p = 2; 

(75) u(x, 0) = u 0 ( x ), (if— — AiJ y 1 / 2 = F\ for t = 0,5r, 


y 3+1 / 2 ~'2yi + y> J /2 1 7 -_i /2 x 1 j 

- 2 - = t Ai (?/ + y 3 ' ) + - <p\ , 


fry* j = ll2 . 

In that case the boundary conditions become 


y 3+1/2 = p(x,t j+l/2 ) for xEjI, 

(77) 

y J+1 = p(x,t j+1 ) for 167 ^ 
and the function 1/+ 1 / 2 can be recovered from the equation 

y j+1/2 - y Al ^ +1/2 = 

with the right-hand side and the known boundary conditions (77), In 
turn, the function y 3 + 1 is found from the equation 

y 3+1 - yA 2 y j+1 = $ 2 +1/2 

with the right-hand side $^ +1 ^ 2 and the known boundary conditions (77), 
Either of these equations can be solved by the standard elimination method. 
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With the basic tools in hand, we proceed to carry out the accurate 
account of the approximation error z^ = z i+ a l 2 = yi+«/ 2 _ u(x,tj +a / 2 ) 
for scheme (75)—(77), where u is a solution of problem (63)—(65) and y is a 
solution of problem (75)—(77), by inserting the value y^ = z^ + u i+«/ 2 


in equation (75). As a final result we obtain 



(78) z i a i a = 4 ^a( z (a) + z (a)) + V’a 

for 

t > r , 

(■ E ~ t Ai ) = ^ 

for 

t = 0,5 r 

z(x, 0) = 0, xEu> h , Z {a) = z i+a ! 2 = 0 

for 

x er h , 

with the member 




(79) if> a = i A a (u Q + u a ) - u fcJa + 0.5 <p a , 


serving as one possible representation for the residual of equation (66) with 
the number a = 1,2. The error of approximation for LOS of the form (75 
)-(77) is viewed as a sum 

(80) ip - •i/’j + tp 2 . 

Further progress in this area will be achieved by utilizing the fact that 
scheme (76) approximates problem (63)—(65) in a summarized sense, and 
■(/’ = 0(t + \h\ 2 ). Indeed, taking into account that 


0.5 A a (u a + ii a ) 

= (L„u)'+ ( “" 1)/2 + 0(h 2 ) 

for 

h,a 

0.5 A„ (u a + ii a ) 

= (L a uy+(““ 1 )/ 2 + 0(/rJ 

for 

x E uA 

/i,a 

1 fd 2 u^ 
u iJ a = 4 {^ / 

,i+(«-0/2 „ 

) +0(r 2 ), 



w = 

+ 0(r 2 ), 



0 

find that ip a — V* a + V 1 )) i where 



0 1 / 

V 1 a — 2 ( 7 '“ 

1 8 2 U , \J + fa- 1 . 1/2 

u “ 2 + /a J 

cv 

= 1,2, 
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and 

f °( h l + r ' 2 ) for x e W ft,a , 

\o(/i a +r 2 ) for iew; i0 . 

Whence it follows that 

ip 2 + ip 2+1 / 2 = 0.5 (Li u — 0.5 it + ,fj) J 

+ 0.5 (1,2 w — 0.5 it + f 2 y + l / 2 

— 0.5 ((Li + L 2 ) w — u -+- /j + / 2 ) 2 + 0.5 r ip 2 ^ . 
With equation (63) in view, the first summand becomes zero: 

(Li + L 2 ) u — it + j — 0 , / = ,/i + / 2 , 


yielding 

(81) ip ( + ip \ = 0 . 

By definition, this means that scheme (75)-(77) generates a summarized 
approximation. The accepted view is to involve the sum 

ip 2 + 2+ ip 2 = 0.5 [(L 2 w — u + / 2 )^ + ' 1 ' /,i + (L 2 w — ii + / 2 ) J 1/, “] 

+ (Li t< — u + /j y 

= ((l, + l 2 ) U - ii + f] + f 2 y + (ip^ 1 / 2 - 2iPl + Ipi- 1 / 2 ) 



making it possible to deduce that 

(82) ip 2 + 2 ip j + ip 0 = t 2 (ip 2 ) = 0(t 2 ) . 

No wishing to load the book down with full details on this point, we 
cite here only final results: LOS of the form (75)-(77) converges in the grid 
norm of the space W 2 with the rate 0(r + \h\ 2 ) if the solution u = u(x,t) 
has in Qt continuous derivatives of the first four orders, the derivatives 
d A u/dx A a satisfy the Lipshitz condition in t and the right-hand side / is 
twice differentiable in t. 
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15. Additive schemes for a system of equations. Later in this section we 
will survey some devices that can be used in trying to produce additive 
schemes for systems of parabolic equations. With this aim, problem (50) 
we have completely posed in Section 2 will serve as a basis for the up-to- 
date presentation of tools and techniques, their theory and applications. In 
this connection we may attempt the operator L in the form L = L~ + L + 
with “triangle” operators L~, L + , the associated matrices k aa of which 
arrange themselves as sums = k~ + k + , where k~ = (k~ sm ) and 
k + = (k +sm ) are triangle matrices with entries 

Cf Cf \ OO > O 


k 


— sm 
oo 


= k 


,sm 

oo 


fc + sm — fc sm 
oo oo 5 


k+ ss 

oo 


0.5 w 


= 0 for ??? > s , = 0 for m < s . 

Observe that the matrices k~ and k + are symmetric each to other, since 
k~ 3m = k +ms , whence it follows that 

o o OO ’ 


^ rvry + Lt n 


•'oo ^oa ~ ^oo f 


f ± _ JL(i,± jE_ 

aa dx„ \ aa dx„ 


By introducing a few auxiliary operators with the properties 


0-1 


L a u = L aa u + ^2 L af) u = L afj 11 > L afj U ~ L a/3 « for /? < a , 


13 = 1 
P 


13 = 1 


Li U = L+ a u + ^ L af} u = ^2 Lip u , Li 0 u = L afj u for /? > a , 

fj- 0+1 /3 = o 

and representing the operator L by a sum 


(83) L = L-+L+, L~ u=Y^L-u, L+ u = Li • 


0=1 


0=1 


the solution of the system of equations (50) or 


(84) 


P , rj 

Xi 2^ W ~ U + u) “ + f “ ) 


0=1 


= 0 , 


p 

E(U 

o = l 


+ fa + )=0 


where 
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reduces to successive solution of the system of 2 p equations 


(85) = 


tj+(a-l)/(2p) — ^ — tj+a/(2p) ■ 


1 <9v __ , + 

2^ = V + « ’ tj + l-a/^p) < 1 < tj+l-^a-D/tfp) ' 


a= 1 , 2 ,... ,p. 


The usual starting procedure is connected with approximating the operators 
by the difference operators A± acting in accordance with the rules 


a p 

A a = X^ A <*P > A a/3 > 

13=1 f3 = ct 

A % u = 0-5 {(k% ' 

In this regard, it seems clear that the operator L± is approximated to 
second order by the difference operator A±, the structure of which involves 
the coefficients k^p taken for all a and /3 either at one and the same moment 
t = tj +1 / 2 or at any another moment t* £ [tj,tj + 1 ]. With these members, 
the additive scheme in question acquires the form 


( 86 ) 


yj' + «/(2p) _ yj+(a-l)/(2p) 

r 


E Kpy 3+fil[2p) + ^-J +al[2p \ 

13= 1 


yi + ai/(2p) _ yi + («i-l)/(2p) 

T 


E A U y j+l3i/(2p) + ( v +y+“ i/(2p) , 

/3 — a 


a = 1 , 2 ,... ,p, 

where a 1 = 2p + 1 — a and /3\ = 2p + 1 — /?. Also, we should indicate the 
direction of index account: a l is being increased from p + 1 to 2 p along 
with decreasing a in reverse order from p to 1 . 

The usual boundary conditions are imposed on the boundary x £ 7 ^: 

yi+a/(‘2p) _ ^j + a/(2p) f or x g ; ft = 1, 2, . . , , p , 

( 87 ) 

y ;+an/( 2 p) = /J ;+a 1 /( 2 p) for g 7 », _ Oq = p + 1 , . . . , 2 p . 
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The initial condition is satisfied exactly: 

(88) y(M) = u 0 (a;). 

The following system of equations emerges in determining yJ+"/( 2 P) = 
and yf+ a i/( 2 P) = y (ai) during the course of the elimination: 

(E -tA’J y (a) = F" , [E- r A+ a )y foi) = F+ , 


O'— 1 

F a = K P ym + T K +yfa-i). 

/3= 1 

P 

F m= r A a^y(/3i) + r ^ +y(m-l) 
/3 = a + l 


Having completed the elimination, we must solve the system of equa¬ 
tions 

( E ~ T Ka)y (a) = F~ . 

In light of the special structure of the diagonal matrices k~ a , whose blocks 
are lower triangle, the components y^ a y s = 1 , 2 ,... ,n, of the unknown 
vector y (Q ^ are to be determined successively by the elimination method in 
passing from a to a +1 and from s to s + 1. By the elimination formulas for 
a three-point equation we constitute in a term-by-term fashion the vectors 
y^ a y a = 1,2, ... ,p. Moving in reverse order from a + 1 to a and from 
s + 1 to s the vectors y^ p+i ^, . .. ,y ^ 2p ) are recovered from the system 

(£-rA+ a )y (ai) = F+. 

Upon terminating this process the resultant vector y ^ 2p ) is just the solution 
y J + 1 = Y(2 P ) on the layer t = t j+l . 

Since the system of differential equations (56) approximates equation 
(50) in a summarized sense in compliance with approximating equation 
(85) by equation ( 86 ) with the number a, the additive scheme ( 86 )—( 88 ) 
generates an approximation of 0(r + |/i| 2 ): 

p 

'l > = Yh = °( T + l /l ! 2 ) • 

< 2=1 
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In concluding this chapter it will be sensible to introduce the space 

° 

SI of all grid vector-functions given on the grid Q h and vanishing on the 
boundary j h of the grid under the inner product structure 

n 

(y, v) = , (y\v s )=. Y y s (x)v s (x)h 1 h 2 ---h p , 

5 = 1 XEtUh 

Having involved the operators 

^ > 

0=1 0=1 
O p 

A ay = ~Y y ' A iy = ~Y A t» y ’ y 6 ^ ’ 

/3=i y-a 

we are going to show that these operators A~ and A + are mutually adjoint 
each to other: 

{A~ y,v) = (y,A+ v) for all y,v£!l, 

if the matrix k = (P™) is symmetric, that is, under the condition of sym¬ 
metry k s a ™ = k™*. Indeed, k^ a = k^ and, because of this, we might 
have 

p a 

(A-y,v) = 0,5 Y Y, l( k ap y *^ Y *J + {Kp y z^ Y x a )\ 

0=1 p-l 
P V 

= 05 + (Kp y.m,v x J] 

fizz i o = /3 
V P 

0 = 1 fizz a 

= °- 5 S.) + (^ v .m-y,J] 

0 = 1 fizz a 

- (y,-4 + v). 
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It follows from the foregoing that 


where 


yielding 


(A y,y) = (^ + y.y) = 0.5Uy,y) > 0.5^ (A y,y) 


AV=-Z 


(Ay,y) = ^(!,y*J a > 8 Y, w IMI 2 - 


Thus, the operators A and A + so defined are positive definite: 

A->6E, A+>6E, S = 4 Cl J2la 2 - 

Stability of scheme (86)—(87) with zero boundary conditions is asserted 
by Theorem 3 in Section 11, due to which a solution of the auxiliary problem 


z tT = A «d z (/T + - 


X^ A «d Z (/3 i) + 


^a)^ 0 . d«O = 0 > z(k, 0)=:0 for 


where 


z (°0 z («-i) 


z (ai) ~ Z( ttl -I) 


satisfies the a priori estimate 


|z i + 1 || <M X ^raax X^ (^« y' +a /(. 2 P) + (*/,+ )f'+i-(«-i)/(2 P )) 


+ M 2 ^ o max E(ll(^) J '' + “ /(2p) || + ll(^) J ' +1 " f0 “ 1)/(2p) |)- 


This supports the view that the additive scheme (86)—(88) converges in the 
grid norm of the space L 2 with the rate 0(\Jt + \h\ 2 ). 
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We will pursue the discussion of additive schemes further with re¬ 
gard to problem (61)—(62) capable of describing the system of hyperbolic 
equations 

m £[^ + (L « +L «) u+f “] =°’ E f « = f - 

a =l ^ 

What has been done is to reduce this system to successive solution of simpler 
equations moving from a to a + 1 : 

(90) ^ = L a u + L+u + f a , a = 1,2,... ,p. 

One possible additive scheme 


( 91 ) — yf at - a = E A «h y (« + S A «h y w) + > 

P /3=1 (3=za 

a = 1 , 2 ,... ,p, (apt) e lo }1 x.lu t , 
y («) = , x a = 0,l a , a = 1,2,,,, ,p , 

y(a;,0) = u 0 (a:), 

can be obtained through the usual approximations of p equations, where 
ip a = f a {x-,i' a ) and t' a = tj +{u /p-u. 5)T , the coefficients k U)3 are taken at 
moment t' a , yt a t a is determined by formula (67) or formula ( 68 ), a p = 0.5 
for p — 2 and a p — 1.5 for p = 3. 

The second initial condition is approximated by setting 

y a/p = u 0 (k) + ——- u 0 (;c) + a -^ r (L u 0 +f(£,0)) , 

p 2p z 

a = 1,2 ,... ,p- 1 . 

Because of these facts, the describing scheme generates a summarized ap- 
proximation 

p 

^ = 0{ - t + n 2 ) • 

1 
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With regard to y J + l = y^ we obtain the system of equations 
(E - a p r 2 A~ a ) y (a) = F a , 

where the right-hand side F a is expressed in terms of the vectors y^p 
/? < a. Such a system can be solved successively moving from a to a + 1 
and from s to s + 1 during the course of the elimination. By interchanging 
the positions of A~ and A+ we arrive at the second scheme 

^ q p 

( CJ2 ) — ytofo = Y, Kp ym + Y ■ 

P 13 = 1 p = a 

In this case the system can be solved successively moving from a + 1 to a 
and from s + 1 to s. Alternation of schemes (91) and (92) leads to the third 
scheme, which interests us. 

By means of the energy method the reader can derive on his/her own 
an a priori estimate for the error z = y — u by exactly the same reasoning as 
before with further reference to the property of summarized approximation. 
On this basis the convergence of additive schemes can be obtained through 
such an analysis. 



10 

Methods for Solving Grid Equations 


In this chapter economical direct and iterative methods are designed for 
numerical solution of difference elliptic equations. 

In Section 1 we confine ourselves to direct economical methods avail¬ 
able for solving boundary-value problems associated with Poisson’s equa¬ 
tion in a rectangle such as the decomposition method and the mathod of 
separation of variables. 

The general theory of iterative methods is presented in the next sec¬ 
tions with regard to an operator equation of the first kind Au — f, where 
A is a self-adjoint operator in a finite-dimensional Euclidean space. The 
applications of such theory to elliptic grid equations began to spread to 
more and more branches as they took on an important place in “real-life” 
situations. 


10.1 DIRECT METHODS 

1. Direct and iterative methods. Recall that the filial results of the dif¬ 
ference. approximation of boundary-value problems associated with elliptic 
equations from Chapter 4 were various systems of linear algebraic equa¬ 
tions (difference or grid equations). The sizes of the appropriate matri¬ 
ces are extra large and equal the total number N of the grid nodes. For 


643 



644 


Methods for Solving Grid Equations 


example, for any grid with steps h along all the directions x i ,x 2 ,... ,x p 
(h l ~ h 2 = ■ ■ ■ = h p = h) the amount of nodal points is N = 0(h~ p ), 
where p is the total number of observations. In the two-dimensional and 
three-dimensional cases N ss 10 4 — 10 6 , for example, for h. = 1/100. More 
specifically, such sparse matrices are of the special band structure and the 
characteristic rations between their greatest and the smallest eigenvalues 
are high-order quantities (~ 10 3 — 10 4 of order 0(h~ 2 )). 

Numerical solution of elliptic grid equations necessitates, in view of 
their peculiarities, creating special economical algorithms, because direct 
economical methods are applicable only in some narrow classes of grid equa¬ 
tions. We will elaborate on this later. 

When solving difference boundary-value problems for Poisson’s equa¬ 
tion in rectangular, angular, cylindrical and spherical systems of coordi¬ 
nates direct economical methods are widely used that are known to us as 
the decomposition method and the method of separation of variables. The 
calculations in both methods for two-dimensional problems require Q arith¬ 
metic operations, Q = 0(N 2 log 2 N), where N is the number of the grid 
nodes along one of the directions. 

As a matter of fact, the first method is some modification of Gaussian 
elimination relating to the odd-even elimination with the accompanying 
factorization, the second one is mostly based on the algorithm of the fast 
Fourier transform. The third method of the matrix elimination seems to 
offer more advantages in the domains of rather complicated configurations, 
but the work during the course of the matrix elimination is done with 
Q = 0(N 4 ) arithmetic operations and the extra storage in connection with 
emerging intermediate values. 

Iterative methods of successive approximation are in common usage 
for rather complicated cases of arbitrary domains, variable coefficients, etc. 
Throughout the entire section, the Dirichlet problem for Poisson’s equation 
is adopted as a model one in the rectangle G = {0 < x a < l a , a = 1,2} 
with the boundary T: 


(1) 


An = 


d 2 u 

fat 


+ 


d 2 i 


x — (aq , x 2 ) £ G , 


-/(*) . 

r ~ l^( x ) > 


and a rectangular grid in G with steps h 1 and h 2 is taken to be 

uq, — t a 0,1,..., N a , h a AG — l a , a — 1 , 2 } 
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The statement of the difference Dirichlet problem associated with 
problem (1) is 


(2) A y=-f{x), xeu h , y\ lh = n(x ), 

A = Ai+A 2 , A a t/ = t/ ioIa , cr =1,2, = y{i 1 h 1 ,i 2 h 2 ), 

Problem (2) was the object of special investigations in Chapter 4, 

2 . The decomposition method. Common practice involves the reduction 
of problem ( 2 ) to the system of vector equations 

(3) Y\ : . C Y . • • Y.-. : F . j = 1, 2,.. . N 2 - 1, 

Yo Fo ) Y « 2 Fw 2 , 

where Yj and Fj are vectors, whose components are the values of the 
solution y i j = ■y(ih 1 ,jh 2 ) and the right-hand side /j ■ = f(ih 1 ,jh 2 ) on the 
yth column of the grid u) h and the difference operator C will be specified 
in the sequel. By re-ordering of the right-hand sides of equations (2) at the 
near-boundary nodes we might agree to consider ■y i j = 0 at the boundary 
nodes for i = 0 and i = N\. 

An alternative form of writing equation (2) may be useful in the fur¬ 
ther development: 

(^) A./-': T (2 y — /?, ]jj ., r , )ij~~ !Ji j + i — Vi j > 

1 < i < Ni - 1, 1 < j < N 2 - 1 , 

y 0 j = Vnj = 0 - 0 <j < N 2 , 

Vio = Vio = 0 i ?A:w 2 = f i iN 2 > 0 < i < N y , 

Vij = fij for 1 < i < Ni - 1, 1 < j < N 2 ~ 1 , 

_ , 1 , 1 
Vij - Jij + Voj , Vn,- i,j - Jn.-Uj + p-CAqj ■ 


where 
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Also, it will be sensible to deal with the newly formed vectors 
(h) Yj (l/i j > V2j > ■ ■ ■ » VNi — i j) ’ 2 0,1,... , IV 2 , 

C h? h 2 \ 

h lflj + ~ h i f*0j> • ■ ■ > j > 

j = 1,2 ,... ,^2 -1. 

Fj = (/tjj, A<2j > ■ • ■ i A'atj~ i j), 3 — 0, IV 2 , 

and a difference operator C acting in accordance with the rule 

(CYj). = (2 y- h \ys lXl )- ■ > 0 < i < Ab, y 0j = = 0 . 

2 2 J 

From such reasoning it seems clear that problem (2) in view is tantamount 
to the system of vector equations (3). 

Let N 2 = 2 n for the clarity only. The main idea behind the decom¬ 
position method is the further successive elimination from the governing 
equations of the vectors Y j with odd numbers and, after this, with even 
numbers divisible 2, 4, 8 etc. Other ideas are connected with setting the 
following equations for j = 2, 4, 6,. . . , A 2 — 2, where A 2 = 2 n : 

~ Yj -2 + CYj-i - Yj = Fj-j, 

— Yj-i + C'Yj — Yj + j = Fj, 

-Y J+ CY ; + 1 -Y i+2 = F J+1 . 

Applying the operator C to the second equation and summing up three 
resultant equations yield a revised “short” system 

(6) -Yj-t + Ct^Yj-Yj+^Fy. j= 2,4,6,... , AO - 2 , 

Y 0 = Fn, Y(v, = Fiv 2 , 

containing only the unknowns with even numbers and involving the mem¬ 
bers 


C (i) _ [ C (0)j 2 _ 2 E j F (D = + C^°^Fy 0) + FjJ 
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Having recovered from the system ( 6 ) the vectors Y j with even numbers, 
we succeed in finding these with odd numbers from the following equations: 

C(°) Y ; - = Fj 0J + Y y + 1 + Y;_i, j = 1,3,5,... ,N 2 - 1. 

The same procedure works albeit with obvious modifications for the vectors 
Y j subject to the system ( 6 ), whose subscripts j are oddly (but unevently) 
even, etc.. As a final result we obtain a proper system of equations with 
regard to all the unknowns: 

(7) C< k ~ l > Y ; - =F;*- 1) + Y j -_ 2 *- 1 +Y j . +2 *-i, 

j = 2^ ~ 1 ,3 ■ 2 fc ~ 1 ,5 ■ 2* ~ 1 ,... ,N 2 -2 k ~ l , 
k = n, n — 1 ,. .. , 2 , 1 , 

Y 0 =Fo, Y W 2 =F W2 , 

where CW and F^ must satisfy the recurrence formulas 

( 8 ) CW = [CC * -1 )] 2 — 2E, k= 1,2,... ,n- 1, = C, 

j_ ^(k— 1 )T?(k ~ 

Xj - * j- 2 *-i + ° *;■ + 1 ! j+ 2 ''- 1 > 

j = 2 k , 2 ■ 2 k , 3 ■ 2 fc , . .. , N 2 - 2 k , k = 1,2, ... , n — 1 . 

The decomposition algorithm necessitates performing the factoriza¬ 
tion of the operator of the special structure 

2 k 

(9) CW = f[{C-nE), ^ = 2cos - ( 2 -7 + - )7r , 

i=i 

making it possible to reduce the further inversion of the operator to 
successive inversion of difference operators by the elimination method. In 
what follows one simple equation 

C^v = ip 


serves to motivate what, is done. With representation (9) in view, the 
sought function v = 1 will appear as the outcome of successive solution 

of three-point difference equations 

(C~^E)v^ = v, (C-n,E)v^ = v^~ 1 \ 1 = 2,3,...,2 fc , 
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or, what amounts to the same, 


2vW-hlvV 

2 ^ < 




h i < x { < /j — h x , 


U (O (0) = = 0. 


The preceding typical equation can be solved by the elimination method 

(k) 

with regard to three-point equations. In giving F) ' the intention is to use 
the formula 


(10) f{* :) = C ik) pj* :) + 

with new vectors py^ and qj-^ still subject to (8): 


(11) C ( %P + qf } = C< k ~^ + qf '~ l) [ 


j +2 


+ (c'(*- 1 )) 2 pS t “ 1) + qy:,;i 1 +q) lo *-i. 




Sk-1) 

‘ 1 i+ 2 ' c 


Granting the decomposition 


( 12 ) 


(k) 0 (k) 

q) = 2 p) 


+ q i~2 


i) 


, (k-l 

+ 


and taking into acount that 


(< k) = (C' (fc_1) ) 2 -2E, 

we recast equation (11) as 

(C( k ~ D) 2 (pf ^ - pf ~ 1} ) = C^” 1 ) (p^, + p f-J.1 + qf~ 1} ) 

with further elimination of C < - k ~ 1 \ The outcome of this is 


C<*-i) s (*-i) = pC*;^, +P M 1 + 




j-i K 


i +2 


p^) = p ^~ 1 ) + sf~ 1) 


with q^-* still subject to (12). Substitution of formula (10) into (7) yields 
[Yy - pf ~ 1} ] = qf ■- 1} + Y- 2 k~i + Y • , 2 t-i , 
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showing the new vectors to be sensible ones. Summarizing, the numerical 
solution of problem (2) can be done using only two operation: inversion of 
the operators C < ^ k ~ l ' ! and summation of relevant vectors in the process of 
calculation of the right-hand sides of these equations. Thus, the computa¬ 
tional procedures include the following steps: 

• specifications of the initial values p^ 0 -* and q^ 0 -* so that 




= F: 


P 


(0) _ 


= 0 


j= 1,2,... ,N 2 - 1; 


• for all k = 1,2,.. . , n — 1 solution of the equations 


Q(k-l) g(^~i) _ 


i J+2 k 


(k-l) 


and calculations of the vectors and by the recurrence for¬ 
mulas 


0) (k- 1) c 

Pj =P 1 + S j 


O-i) 


q T) _ 2p W + qy^fii + qY, 


h- 2 " 


' 1 j+2 fc 


for all j = 2 k , 2 ■ 2 k , 3 ■ 2 k ,... , N 2 - 2 k ; 
• the solution of the equations 


rAk- _i_V 

C Sj — q ; - + Y j_ 2 k-i + iy +2 t-i , 


Fn 


for determination of the unknown vectors by the formula 


v O- 

Y ; 


+ S 


0-1) 


for ally = 2 k ~\‘i-2 k ~\h-2 k ~\ . .. , N 2 -2 k ~\ k = n,n- 1,.. . , 1. 

During the course of the decomposition method the users will perform 
Q = 0{N\ N 2 log 2 N 2 ) arithmetic operations with the extra storage about 
1.5./V, where N is the total number of the unknowns. Some modification of 
the preceding algorithm with insignificant prolongations in time may be of 
assistance in mastering the last difficulty involved. 
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3. The method of separation of variables. The problem we must solve is 
problem (2) with the homogeneous boundary conditions 


(13) 


A y= ~<p, y\ lh = 0 . 


where the function <p differs from the right-hand side / of problem (2) only 

at the near-boundary nodes in the following way: within the quantity — 

h ^ 

1 1 
for i | = 1, i 1 — Ni — 1 and within the quantity — for i 2 — l, i 2 = vV 2 — 1. 

h 2 

Before giving further motivations, it will be sensible to introduce the 
eigenfunction y k {jh 2 ) and the eigenvalue \ k with the number k of the 
problem 

(14) A 2 jJ k + X k n k = 0 , h 2 < ;c 2 < l 2 — h 2 , AC.O) = = 0 ■ 

We learn from Chapter 2 that 


. . , , 2 . k tt j , 4 . , k 7r h 2 

kkOh) = \lr sm cc-> Xk = j^ sm ~rT’ = 1,2,..., — 1, 


l 2 n 2 


and may attempt a solution of problem (13) in the form 
N 2 -l 

(15) Vij = c k( ih i)yk(jh 2 ), 

k = 1 

i=l,2,... j = 1,2,... ,N 2 ~l, 

where the Fourier coefficient c k depends on aq = ih l . 

Upon substituting representation (15) info equation (13) we obtain 

A y = Ai y + A 2 y 


N 2-1 

= Xi [f i kti h 2 )kiC k (ih l ) + fi k (jh 2 )A 2 c k (ih l )] 

k = 1 


Nj-l 

= - Xi ^('AJacO'A)- 

k = l 


( 16 ) 



Direct methods 


651 


where ip k (ih 1 ) is the Fourier coefficient of the function <f(x): 

n 2 ~ i 

‘fki ih l) = Yl ‘P{i- h l,i h 2)Hk{j h -2) h 2- 

i=l 

Due to the problem statement (14) and the orthogonality of the functions 
/l<j. we derive from (16) the problem statement for determination of the 
numbers c k for all k = 1, 2, .. . , 1V 2 — 1: 

(17) Ai c k - \ k c k = -<p k , h, < x, < l l - h lt c k (0) = = 0 . 


Because of this form, the applications of the elimination method for 
N 2 — 1 times to c k (ih 1 ) as a function of the argument x x — ih t for fixed k 
permit us to find a solution of problem (13) by means of formula (15). As 
can readily be observed, the calculations of the Fourier coefficients <p k and 
solutions t/jj can be carried out by the same formulas related to common 
sums of the special type 


tv -1 

E 

k = 1 


z,. sin ■ 


kirj 
N : 


3 = 1,2, 


,N - 1. 


Omitting more details on this point, we refer the readers to the well- 
developed algorithm of the fast Fourier transform, in the framework of 
which Q arithmetic operations, Q ~ 2iVlog,yV, N = 2 n , are necessary in 
connection with computations of these sums (instead of 0(N J ) in the case 
of the usual summation), thus causing 0(ni ./V 2 log, N 2 ) arithmetic opera¬ 
tions performed in the numerical solution of the Dirichlet problem (2) in a 
rectangle. 

In such matters some progress can be achieved by combinations of 
the decomposition method and the method of separation of variables. For 
example, this can be done using the method of separation of variables 
for the “reduced” system (6) upon eliminating the unknown vectors with 
odd subscripts j. This trick allows one to solve problem (2): here the 
expenditures of time are Q ss 2mn2log 2 N 2 arithmetic operation, half as 
much than required before in the method of separation of variables. 

4. The method of matrix elimination. The system of equations (3) is one 
particular case of the following problem: 


(18) -Aj Yy_i + Cj Yj - Bj Yj + i = Fy , j = 1,2,... , N - 1, 
Co Y 0 — So Y| = Fq , —An Yn_o + C'n Y« = Fw , 



652 


Methods for Solving Grid Equations 


where Yy and Fy are vectors of the same order My, Cj is a square matrix 
of size My x My, Aj is a rectangular matrix of size Mj x My_i and Bj is a 
rectangular matrix of size Mj x My + 1 . As usual, we may attempt a solution 
of this problem in the form 

(19) Yy = a ] + l Yj + l + P ] + 1 , j = 

where a - is a rectangular My_x x My-matrix and /?y is an My_i-dimen.sional 
vector. Following established practice with Gaussian elimination, we derive 
from (18)—(19) the recurrence relations for finding ay and /?■ both: 

a j + l = (Cj - Aj dj)~ l Bj , j = 1,2,.. . , N - 1 , 

a i = Co 1 Bo, 

Pj + 1 = (Cj - A +A 3 l3 3 ), j = 1,2,... , N - 1, N , 

A = C'(C 1 F o, 

Y n = (Gw — An &n) ^ (E n + bi-w Av) = Av+i > 

Yy = a j+1 Yy + 1 + /3 y+1 , y = N - 1, ;Y - 2,... , 1,0 . 

For a complete and rigorous treatment, it is required that 


II Cq 1 Bo || < 1, || An || < 1, 

II CJ 1 Aj || + || C~ l Bj || < 1, l<i<Y~l, 

and, moreover, at least one of these inequalities should be strict. This 
provides the sufficient background for the stability of the matrix elimination 
method with respect to random errors, meaning || a - || < 1, j = 1, 2, . . . , N. 
In the case (3), which interests us, the members become Aj = Bj = E , 
Gy = C for 1 < j < N — 1 and Bo = An = 0, Go = C'n = E, by means of 
which the ensuing formulas can be written in simplified form: 


p 

+ 

II 

cy 

1 

J? 

A 

a 1 = 0 , 

y = 1,2,... 


A+i ~ a i+i (A c f3j ) , 

A 

1! 

O 

j = 1,2,... 

, A - 1 , 

= a j +1 + ! + A + I’ 

Y n 2 - F n 2 , 

j = N 2 - 1, 

... ,2,1 . 
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Here Y j and f3j are vectors of order — 1, ay and C are square matrices 
of the same size (N i — 1) x (Ni — 1). Then the unique sufficient condition 
of stability is 

II C- 1 1| <0.5. 

This is certainly true, since C > 2 E. 

Proper evaluation of the necessary actions in solving problem (5) by 
the matrix elimination method is stipulated, as usual, by the special struc¬ 
tures of the matrices involved. Because all the matrices a - are complete in 
spite of the fact that C is a tridiagonal matrix, 0(Aj 3 ) arithmetic opera¬ 
tions are required for determination of one matrix ay + 1 on the basis of ay 
all of which are known to us in advance. Thus, it is necessary to perform 
0(N^ N 2 ) operations in practical implementations with all the matrices 
ay, j = 1,2,... ,N- 2 - Further, O(N^) arithmetic operations are required 
for determination of one vector /?- +1 with knowledge of /?• and 0(Nf N 2 ) 
operations for determination of all vectors /?■_ 

With regard to all the Yy’s, the same number of operations suffice 
and so the total volume is still Q = 0(Nf N 2 ). 


10.2 TWO-LAYER ITERATION SCHEMES 

1. Two-layer iteration schemes. The problem statement. In what follows 
it is required to solve a first kind equation of the form 

(1) Au = f t 

where A : H H is a linear operator in a finite-dimensional real space H 
of the dimension N with an inner product (, ) and associated norm || y || = 
\f(y, y). In a common setting it is supposed that A = A* >0, where / £ H 
is an arbitrtary vector. From the viewpoint of possible applications, any 
iterative method provides proper guidelines for successive determination 
of approximate solutions y 1 ,y 2 ,-- - , Vk, f4 + i > ■ ■ ■ t° equation (1) with the 
.starting point (the initial approximation) y 0 £ H. Any such approximations 
are known as iterations with relevant iteration numbers k — 1,2,.... The 
essence of these methods is that the value yt + i can be obtained through the 
preceding iterations y/;_i, y k , .... An iterative method is called a one-step 
method or a two-step method if only one or two preceding iterations 
are needed in finding every value y k+ i. As we will see later, these methods 
fall within the category of two-layer and three-layer methods, respectively, 
on the same footing as in Chapter 6. What is more, the one-step iterative 
method coincides in form with a two-layer scheme designed in Chapter 6. 
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Before going further, we recall that any linear one-step iterative me¬ 
thod can be written as 

(2) Bk Vk+i = Cfc 4 + Fk, k — 0,1,2,..., 

where Bk and Ck are linear operators from the space H into the space 
H depending, generally speaking, on the iteration number k, Fk £ H is a 
known function of k and y k is the fcth iteration, under the agreement that all 
the inverses B k l exist. A natural requirement in the further development 
is that the exact solution u to equation (1), not depending on k, should 
identical^ satisfy equation (2): 


(Bk - Ck)u = Fk. 


But it is possible only if (Bk — Ck) A 1 f = Fk, implying that 
• the inverse operator (Bk — C'k)~ l exists; 

. f = A(B k -Ck)- l F k . 

This is acceptable if we agree to consider 

r k+i( B k - Ck) = A, F k = f r k + l , k = 0,1,2,..., 

where r k+1 > 0 is a numerical parameter. Under such an approach the 
canonical form of two-layer iteration schemes is 

(3) Bk yk - ±±~ - ^ + Ay k =f, k = 0 , 1 , 2 ,..., 

T k +1 

where the initial approximation y 0 G H is free to be chosen in any con¬ 
venient way. Since the inverse B k l exists, it follows from the foregoing 
that 

( 4 ) Vk+i = Vk - r k+1 Bl 1 (A y k - /) 

or, what amounts to the same, 

Vk+i =Vk- T k +i B k 1 r k=yk~~ T k +i Wk > 

where r k = Ay k — f is the residual and w k = B k l r k is the correction. 
With knowledge of y k the value of + 1 can be recovered from equation 
(4). Knowing y 0 , it is plain to determine successively y 1 , y 2 .. .. Of course, 
it is meaningful only for convergent iterative methods: 


(5) 


II24II—>0 as t 


oo . 
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The usual practice involves the numerical solution of problem (5) with 
a prescribed accuracy e > 0 (a relative accuracy || y k — «||/||y 0 — u||), it 
being understood that the calculations should be terminated if 

(6) || 24 ~ u II < £ II Vo ~ m || . 

In connection with inconvenience caused by the unknown vector u, it seems 
reasonable to replace this condition by the inequality for the residual 

(7) \\Ay k - f\\<e\\Ay 0 - f\\. 

In the general case the accepted view is the termination condition of 
the type 

(8) 1124- — u II_d — e 11% — m II_d > 

where D = D* > 0 is some operator. By merely setting D = A 2 we deduce 
from ( 8 ) inequality (7). 

We are now interested in the governing equation related to the residual 
z k = 14 — u. Since Au = /, we might have 

(9) B k Zk+1 ~ Zk +Az k = 0, 41 = 0,1,2,..., 

T k + l 

where z 0 G H is known. As far as B k = B is independent of the subscript 
k, the correction w k = B~ 1 r k satisfies the homogeneous equation 


B 


w k+1 - w k 


T k + 1 


+ Aw k = 0 . 


Indeed, (4) implies that 

24+i - Vk = ~ T k+i B ~ l r k = ~Th+y w k • 

Applying the operator A twice to both sides of the preceding equality and 
taking into account that 

Ay k+l - A y k = (Ay k + l - f) - (Ay k - f) - r k+l - r k , 
r k+ 1 ~ r k = B {B~ 1 r k+l - B~ 1 r k ) = B (w k+[ - w k ), 
we establish the homogeneous equation for the correction w k . 
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Also, it seems clear from (9) that 

z k+ i=Sk + iz k , Sk + i = E - r k+1 B k X A , 

where Sk + [ is the transition operator from the layer k to the layer k + 1. 
Having completed the elimination of z k , z k _ 1 , ... , z i , we find for k = n — 1 
that 

-'P, — k\) c'o, k\) — S n S n — i • • .S ‘j S'] , 

where T n is the resolving operator of scheme (9). This serves to motivate 
the estimates 

II 2 !jIIl> = ~ \\ ri n\\ D ■ H-'oll+l or 

IIAiII+i — In II 2 oIIlo In = l|-^n|lij • 

From such reasoning it seems clear that the condition of termination is 
ensured if q n < e, thereby reducing the question of convergence of the 
iterations to the norm estimation of the resolving operator T n . 

Scheme (3) generates an exact approximation on a solution u of the 
equation Au = f for any operators {B n } and any choice of the parameters 
but the quantity q n depends on { B n } and {r fc+1 } both. Some 
consensus of opinion here is that { B n } and {r^j} should be so chosen as 
to minimize the norm 11TAi11^ = q n of the resolving operator T n of scheme 
(3) and to minimize the total number of arithmetic operations which will 
be needed for recovering the value j/j . +1 from the equation 

Bk 24+i = F k , F k = B k y k ~ r k + l {A y k . - /) , 

with a known value 24 +i . 

In accordance with what has been said above, any iteration scheme 
(3) can be treated as a two-layer scheme being used for solving the nonsta¬ 
tionary problem 

B % + A “=f’ 

where the parameter Ty+j regards to one possible step in a nonreal time 
t k+ i — J2rn=iTm- The main differences between iteration schemes and 
available schemes for nonstationary problems are: 

• the iteration scheme (3) approximates exactly equation (1), since 
a solution u to equation (1) satisfies equation (3) for any B k and 
T k- 1-1 > 
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• proper choices of the parameter T k+1 and the operators B k are 
caused only by the necessity of convergence of the iterations and the 
economy requirements in trying to solve the original problem with 
a prescribed accuracy, while the restrictions on the steps for non¬ 
stationary problems are connected with the approximations which 
do arise in such matters. 

Let now Q(c) be the total number of arithmetic operations necessary 
for obtaining a solution to equation (1) with a prescribed accuracy e > 0 
regardless of the initial approximation in the iteration scheme (3). Its 
ingredients Bk and r k should be so chosen as to minimize the quantity 
Q(s). If the desirable accuracy can be attained in a minimal number of the 
iterations n = 71 (e), then 


n(c) 

Q(e) — Qk — Qn'n ) 

k=i 

where Q k is the number of the necessary actions during the course of *th 
iteration. Thus, the minimum problem for Q(e) reduces to the minimum 
problems for 71(e) and the number Q k , which depends on B k . 

In this context, if Bk = E is the identity operator, then scheme (3) 
refers to explicit iteration schemes of the structure 

(10) Vk+I-Vk +Ayk = f> k = 0,1,2,..., for any y 0 £ H . 

T k +1 

If Bk yf E, then scheme (3) is termed an implicit iteration scheme. 

2. A stationary scheme. The main theorem on the convergence of itera¬ 
tions. Quite often, the iteration schemes such as 

(3') B yk+i-v k + Ay = ft * = o,i,..., 

r 

with a constant operator B and constant r are called stationary meth¬ 
ods of iterations. In particular, the upper relaxation method and Seidel 
method fall within the category of such methods. In that case equation (9) 
related to the error of approximation z k = y k — u takes the form 

(9') B Zk+1 ~ Zk +Az k = 0, * = 0,1,..., z 0 = y 0 -u, 

r 

and it remains valid for the correction w k = B~ 1 (Ay k — f). The operator B 
is, generally speaking, non-self-adjoint and possesses the own inverse B~ 1 . 
This type of situation is covered by the following assertion. 
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Theorem 1 If A is a self-adjoint operator [A = A* >0), then 

( 11 ) B>~tA or (Bx, x) > - r (Ax, x) for all x £ H 

is a sufficient condition for the convergence of the method of iterations (3') 
in the space Ha with the rate of convergence of a geometric progression 

( 12 ) 11^+ilU <P\\n\\ A > * = 0 , 1 ,..., P< 1 , 

where p = (1 — 2 t 6 t 6/\\ B \\ 2 )A 2 is its denominator and 6 = mini A k (A), 
5* = mini Aj.(_B 0 — tA/ 2), B 0 = (B + B*)/2 is the symmetric part of the 
operator B. 

Proof Knowing from (3') z k+l = Sz k with the operator S = E — tB~ 1 A, 
we find that 


II z k + l lly; — {Az k + 1 ,Z k + l ) — (A,Sz k , Sz k ) 

= {ME - rB- l A)z k , (E - rB~ 1 A)z k )) 

= II ^ 111 - r [i AB ~ l Az k ,z k ) + (B~ l Az k , Az k )\ 

+ T 2 (AB- l Az k ,B~ [ Az k ). 

With the relation A — A* in view, we deduce upon substituting here Az k = 
—Bv k and v k = —B~ l Az k , where v k — A {z k+l — z k ), that 

(13) ||^. +i lll = \\z k \\ 2 A -2r((B-TA/2)v k ,v k ). 

Because of (11), by utilizing the fact that the operator P = B — tA/2 is 
positive we establish its positive definiteness in a finite-dimensional space 
H (for more detail see Chapter 2, Section 1): 

(11') B — -t A > S t E , (5* > 0 , 

where S t is the smallest eigenvalue of the operator Pq = Bo — ~ ryl, .so that 
2 t((B - ~T A )v k ,v k ) > 2r <5* || v k || 2 . 


(130 



Two-layer iteration schemes 


659 


On the other hand, it follows from the foregoing that 

II** II 2 A = (Az k ,z k ) = (Bv k ,A~ l Bv k ) 

• ll^tll 2 

<lh4~Ml ■ II B || 2 • | K . || 2 

= HTM 

6 


yielding 

(M) Ik.lh* II; ■ 

By inserting (13') and (14) in (13), it is possible to show that the bilaterial 
estimate 

\\z k+ i\\ 2 A = \\Sz k \\ 2 A <p 2 \\z k \\ 2 A 

becomes valid with p 2 — 1 — 2r<5<5*/|| B || 2 < 1, assuring estimate (12) and 
the inequality || z n ||^ < p n || z a || and justifying the convergence of the 
iterations, since p n —- 0 as n oo. The same estimate is certainly true 
with the correction w n = B~ i (A-y n — /). 

Remark Condition (11) for fixed B may be viewed as a selection rule for 
those values of r for which the iterations converge. For example, for the 
explicit scheme with the identity operator B ~ E condition (IF) is ensured 
if all the eigenvalues are subject to the relation 

x k {E- ^ tA) = 1 - ^rX k {A) > 0 

or, what amounts to the same, 

1— ^r||A||>0. 

Thus, the iterations converge for any r < 2/||v4||. Let us stress here that 
the estimate obtained for p is too rough for determination of the total 
number n(e, N) of the necessary iterations and indicates mainly the true 
order in n as iV -» m, 
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3. The explicit scheme with optimal set of Chebyshev’s parameters. In 

what follows the intention is to use the explicit scheme ( 10 ) without concern 
for how the parameters 77 , r 2 , . ,. , r n will be chosen in trying to minimize 
the total number of iterations n = n(e). Also, under the agreement that the 
operator A is self-adjoint and positive we operate with its smallest 7 j > 0 
and greatest y 2 eigenvalues: 

(15) A = A* > 0 , 7 i E < A < y 2 E , 7 j > 0 . 

The meaning of this is that we should have 

7 i || x || 2 < (Ax,x) < 7 2 || x || 2 for any x G H . 

If the parameter r = const is independent of the subscript k, that is, 
Tj = r, =; • • • = r n — t , scheme ( 10 ) is called the simple iteration scheme: 

(16) Vk+i ~ Vk ~ T (A Vk — f) • 

In Section 1 of the present chapter we have established that the residual 
77 = A y k — / satisfies the homogeneous equation 

(17) r ~ rf ' 1 —+ Ar k = 0 , k = 0,1,2,..., r 0 = Ay 0 -f£H, 

T k + 1 

or r k+l = Sk+ir k , Sk+i = E — r k+1 A, showing a way of relating r n and r 0 : 

(18) r n = T n r 0 , t n = Sj S 2 • ■ ■ S„ . 

Here T n is the resolving operator being a polynomial of degree n with 
respect to the operator A: 

(19) T n = V„{A) = {E- t,A) (E - t 2 A) ■ ■ ■ (E - r n A) , 

so that r n = V n (A)r 0 . On this basis the residual r n obeys the estimate 

(20) \\r n \\<\\Vn(A)\\ ■ \\r 0 \\ = qn \\r 0 \\. 

The next step is to evaluate the quantity || V n (A) || of interest in terms 
of 7 j and 7 ,, making it possible to extract those parameters 77 , r 2 , .. . , r n , 
for which the minimal value of q n = ||'P n (A) || is attained. The preceding 
polynomial 


n n 

Vn(A)=: H(E-T m A) = J2c k A k , C 0 = 1, P„(0) = 1, 

m = 1 A: — 0 
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refers to self-adjoint operators, since any degree of the operator A also is a 
self-adjoint operator: A m = (A’")*. 

Let {A s ,£ 4 } be eigenvalues and orthonormal eigenfunctions of the op¬ 
erator A: 


A£ S = A S £ S , s=l,2,...,N, 0 < Aj < A 2 < ■■ • < , 

where N is the dimension of the space H and Aj = min s A s = ~f lt X N = 
max s A s = 7 2 . By definition, 

A%= A s A k ~%= A*£, , 

meaning that X k is one of the eigenvalues of the operator A k . This serves 
as a basis for the representations 


c k Ak = ( Y2 c k 

1=0 \k=0 

and, on the same grounds, X(V n {A)) = P n {X(A)). 

Thus, the eigenvalues of the polynomial P n {A) are equal to the poly¬ 
nomial V n { A) of the eigenvalues A = A(T) of the operator A. With the 
relation (P„(A))* = P„(A) established, we find that 

(21) \\Pn{A)\\< max \P„{x)\. 

7l <^<72 


n 

/ p n {A)i i = y j 


jt,=Vn( A.K, 


Because of this, the problem of searching for min ||'P n ( J 4)|| can be 

T 1 i r 2 > ■ ■ ■ > T n 

reduced to the well-known minimax problem for the polynomial P n (x) in 
question. By interchanging the variables by the rule 

(22) x = 0.5 [(t 2 - 7j)f + 7 2 +7i] 


the segment [ 7 ^ 72 ] carries into the segment [—1, 1], so that P„(x) = P n (t), 
t G [-1, 1], and P n ( 0) = 1. 

With the detailed forms in mind, a revised statement of the problem 
consists of finding a polynomial with minimal deviations from zero on the 
segment [—1,1] such that max \P n {t)\ is minimal under the additional 

condition of normalization P,,(t 0 ) = 1, where the point t 0 corresponds to 
the point x = 0. From formula (22) it follows for x = 0 that 

7 2 +7i 


( 23 ) 


72 “ 7i 
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Thus, the well-known Chebyshev polynomial defined by 


V n (t) = 


T n (t) 

Tn(t 0 ) ' 


where 


(24) T n (t) = cos (n arccos t ) for \t \ < 1, 

is just the solution of the original problem concerned, For |i| > 1 the 
polynomial of interest is specified by the formula 


(25) 


T n (t) = 0.5 


(t + \A 2 - I) n + (t - \R rz T) n 


> l. 


Since max \T n (t) \ = 1, the relations occur: 
hl<i 

(26) min max \P n {x)\ = min max \T n (t)\ = = q n . 

irj,} 7i <r<72 {r k } ~ l<t<l l J n(l 0 )| 

In an attempt to find the unknown parameters t x , r 2 , . . . , r n by the ap¬ 
proved rule saying that the zeroes of the sought polynomial V n (t) should 
coincide with known zeroes of Chebyshev’s polynomial such as 

x 2& — 1 , , 

(27) t k ~ cos - 7 r, k = 1, 2,... , n , 

2 n 

we recall from calculus that the polynomial 


V n {x) = (1 - rpr)(l - t 2 x) •••(!- r n x) 


has zeroes at the points x k = 1 /r k , k = 1,2,.,, ,n. By formula (22), 
relating x and t, we deduce that 

2 = [(Tl + 7 2 ) + (72 - 7l)**:] T k , 


giving 


n 


k = 1 , 2 , 


(7i + 7 2 + (7 2 - 7i )4) ’ 

Also, it will be sensible to introduce more compact notations 

1 - £ 1 - ^ 2 


7i_ 
7 2 ' 


Po 


l + < 


Pi 


74 + 72 


( 28 ) 
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All this enables us to write down 

(29) r k = T ° , k= 1,2,... ,n, 

1 + Po T k 

thereby completing the task of motivating the choice of the parameters 
Tj, r 2 , . . . ,T n . The expression for q n — l/|T n (t 0 )|, t 0 = — l/p Q , is needed as 
further developments occur. Since |t | 0 > 1, applying formula (25) to T n (t 0 ) 
yields 



By minor changes the expressions in various brackets are modified into 


1 

-b 

Po 


1 

Po 

and, hence, 

(30) 


'--1 

Po 


Pi 1 


l±y/ER = L(i + 

Po Po l 


4e 


1 + s + 2 i/£ 


i-e 

i+e 


2 >/£ 


1 + 

l-v^ 

__ l-V? 

i-e i + v^ 

2 < 

i+ pf 


/(i + O 2 

i 

Pi ’ 

Pi 


( .lr. 


Thus, for scheme (14) with optimal set of the parameters , r 2 , . .. 
given by formula (29) the relation 


(31) 


\ A Vn -/II < 1n\\ A yo “/I 


is valid with q n still subject to (30). 

The number n = n(e) is so chosen as to satisfy the condition 


2 P" 

1 +Pf 


< £ . 


For this, it suffices to require in the further derivation that p™ < e/2 or, 
what amounts to the same, that 


„>M 

~ in (1/Pi) 


( 32 ) 
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The well-established expansion of the function 


In 


1 + x 


2x + - 


1 


+ 


1 


1 — x ~'~'3^(l+2:) 3 (1 — x) 3 j 

where 0 < x < x, is aimed at establishing the relations 


ar, 0 < x < 1 


i 1 + x 

in -- > 2 x 


1 - x p x 

and, hence, inequality (32) holds true for 


!»! = !„ i±T>2yf 


(33) 


, , , , In (2/e) 1 FyP 2 

»>»„(£), "‘ iS) = 2JT = * V 7, e ' 


This estimate is more convenient in practical implementations than esti¬ 
mate (32). 

4. The simple iteration scheme. By formally setting n = 1 in formula (29) 
the preceding is referred to as the simple iteration method 

(34) Vk+1 ~ Vk +Ay k = f 

T 0 

with the parameter r 0 incorporated: 

(34') 


7i +7 2 


Here t j = cos = 0, t, = r 0 and 


(35) 


<h 


2 P 1 
1 +Pf 


P 0 


The equation for the residual r k = Ay k — f reduces to y k+ i = Sy k , 
,S = E~t q A. As far as the operator T) = S is concerned, formulas (20) and 
(35) together imply the estimate for the norm of the transition operator 


,S’II = 


P 0 


i-e 

i + r 


By making n iterations of the simple iteration method we find that 


S n 


<Pa IK II- 
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The condition p' 1 < e is ensured if 


n > 


which is certainly true for 
(36) n>n 0 {e) 


M 1 /^) 

ln (i/Po) 


»o(e) 


ln(l/c 


5. A model problem. Comparison of methods. Further comparison of vari¬ 
ous iterative methods will be conducted by having recourse to the Dirichlet 
problem associated with Poisson’s equation in the square {0 < x 1 < 1, 
0 < *2 < 1 } of the unit sides /j = / 2 = 1 and posed on a square grid c o h 
with steps h 1 ~ h 2 = h. As a special case of problem (2) in Section 2, the 
problem of interest is characterized by the grid equations 


(37) 

where 


Ay = Ai y + A 2 y = -f(x), x£w h , 

y{ + ic) _ 2y + y(-lo) 


y I 


T % 


0 . 


A Q y = y$ 


h 2 


a = 1,2. 


The system of equations (37) can be recast in the operator form as 

0 

Ay = f, where Ay = —Ay in the space H = of all grid functions given 
on the grid Co h and vanishing on its boundary j h . An inner product and 
associated norm in that space Ii are defined by 


(y,v) = E y{x)v(x)h 2 


V(v> y) ■ 


We spoke about the operator A a lot of time in Chapter 4: it is self- 
adjoint, positive and possesses the eigenvalues 


A 


k\ k 2 


sin* 




+ sin' 


7 t k 2 h 


so that 


k a = 1,2,... ,N- 1, a = 1,2, 


( 38 ) 


8 . 9 7T h 

7 i = nun X klk2 = ^ sur — 


7 2 = max 4, k 2 = ry 


8 9 7 t h 
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In what follows problem (37) will be treated as a model one in the 
further comparison of various methods in a step-by-step fashion in line with 
established priorities and answering real needs. We concentrate primarily 
on the total number of the iterations required in the simple iteration method 
(34)-(34 / ) and the method with optimal set of Chebyshev’s parameters (14), 
(29). 

Recall that it is fairly common to write the iteration number k over 
the sought function y within the frameworks of iterative methods available 
for difference equations. The same procedure works in the simple iteration 
scheme (SIS) which has been designed for problem (37): 

(39) y =y+T 0 (Ay+f), 


where 


2 


7i + 72 


Jr 

T 


Upon substituting the assigned value into (39) we derive the formula 

— ^1^2 — 1 T JJi i ,2 2 “t“ i ^ 


(40) 


k -\-1 

Vi, 


■hi 


by means of which the (k + l)th iteration is completed. 

For the explicit scheme (14) with Chebyshev’s parameters (SCP) the 
calculations are performed by the formula. 

k + l _ k T k + l 

y i i i 2 ~ Vii i2 3" L2 


X 


Vii-1, i 2 + %i + l,i 2 + + Viur + l 


. k 

4 % i; 


where 


+ T k + lfn i 3 < 


T k +1 — 


1 


3 + Po tk 4 1 + Po 4 


Since the volumes of computations in determining y in these methods 
differ slightly, the main criterion in such matters is the total number of the 
iterations. By formula (38) we find for h <Cl that 


£ = 


7i 




r, 7T h 7T 2 h 2 


72 “2 4 

For example, the reasonable accuracy e = 2e~ 10 
n 0 (e) k, T 4 in the case of SCP and for n 0 (e) p- 
making it possible to fill in the following table regardless of the initial 
approximation, that is, for any element y 0 of the space H , 


10 4 is attained for 
in the case of SIS, 
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h 

SIS 

SCP 

1/10 

200 

32 

1/50 

5000 

160 

1/100 

20000 

320 


From here it seems clear that much more iterations are needed in SIS than 
in SCP which is, generally speaking, preferable. 

However, some progress may be achieved in reducing the total number 
of operations by making the well-founded choice of the initial approxima¬ 
tion. 

6. On computational stability of iterative methods. Until recent years the 
iterative method with optimal set of Chebyshev’s parameters was of little 
use in numerical solution of grid equations. This can be explained by real 
facts that various sequences turn out to be nonequivalent in computational 
procedures. 

At the initial stage such of such an analysis of algorithms it is usu¬ 
ally supposed that a computing process is ideal, that, is, computations are 
carried out with an infinite number of significant digits. But any computer 
makes calculations with a finite speed and a finite number of digits. Not all 
numbers are accessible to computers, there are computer null and computer- 
infinity. For instance, abnormal termination occurs when computer infinity 
arises during the course of execution. A computing process may become 
unstable, thus causing difficulties. In such cases rounding errors may ac¬ 
cumulate to a considerable extent so that the algorithm will be useless in 
practical applications 

For example, for doing so with the set of Chebyshev’s parameters t k 
in increasing order 

2k — \ 

(41) t k = cos— -7 T, k = 1,2,... ,n, 

In 

or in reverse order 

2k — \ 

(42) t k = ~ cos— -7 T, k = l,2,...,n, 

2n 

abnormal terminations may occur for sufficiently small £ in connection with 
growing intermediate values y k for k < n. Such a danger is caused by a 
nonmonotone character of the approximation y k to u, since the norm of the 
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operator Sk — E — r k A associated with the transition from the (k — l)th 
iteration to the fcth iteration may be greater than 1 for negative values of 

^k- 

Before proceeding to further discussions, let us give the details of a 
simple example. 

Example The system of equations to be solved is 

- 2r(s,) + v(x i+1 ) ~ 0 , x i = ih , 1 < i < N - 1 , 

n(0) = 1 , n(l) = 0 , h-l/N, 
relating to the problem 

u" = 0 , 0 < x < 1 , u(0) = 1 , u(l) = 0 , 

for which the exact solutions are known: 

u(x) = 1 — x , v ( x i) — 1 — x i ■ 

In that case the ingredients become 

4 . i 7T h 4 2 7T /l 2 71 '^ 

Ay=-y,„ 7, = y«n- T , T , = -c« T , ? = tg—. 

For convenience in analysis and clarity, we take into consideration 19 equa¬ 
tions (N=20) and set c = 10 -4 . The analytical estimate (33) gives n 0 (e) = 
63.2, so that n = 64 and the parameters , r n for n = 64 are 

specified by formulas (29) and (41). The final results of computational 
procedures are presented below in Table 3. 


Table 3 


k 

A k 

53 

0.12 

54 

1.5 

55 

27 

56 

6.3 • 10 2 

57 

1.9 ■ 10 4 

58 

7.2 • 10 5 

59 

3.7 ■ 10 7 

60 

2.6 ■ 10 9 

61 

2.5 ■ 10 n 

62 

3,3 ■ 10 13 

63 

5.0 ■ 10 15 


Table 4 


k 

A* 

i 

39.6 

2 

2.6 ■ 10 3 

3 

1.6 ■ 10 5 

4 

8,2 • 10 6 

5 

3,7 ■ 10 s 

6 

1.2 ■ 10 10 

7 

3.3 ■ 10 n 

8 

7,0 • 10 12 

9 

1.2 ■ 10 14 

10 

1.7 ■ 10 15 

11 

1,9 • 10 16 
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The iteration number k is recorded along the first column and the 
quantity of interest 

A k = 1124 - y k -i\\ c = max |y A .(a: i ) - y k -i(Xi)\ 

0 < 07 < 1 

is placed along the second one, From here it is easily seen that the iteration 
process is divergent, thus causing abnormal termination for k= 64. 

By obvious rearranging of the parameters r k in reverse order in con¬ 
formity with formula. (42) the inherent instability of this process is more 
significant due to the fact that abnormal termination occurs very fastly for 
k= 12 (see Table 4). 

In this regard, rounding errors can be treated as possible perturbations 
of the right-hand side of equation (1) at every step, The iteration scheme 
(14) with parameters (29), (41) or (42) becomes unstable with respect to 
the right-hand side by exactly the same reasoning as before; the norm of 
the operator Sk = E — r k A for the transition from the (k — l)th iteration 
to the kth iteration may exceed 1 for negative values of t k , since 


I 5* 11 = 


Po (1 + 14-1 


for 1 1 . < 0 , 


1 “Po I4l 
| -S'* || > 1 for Po (1 + 2 \t k |) > 1 


By the same token, 


5*1 


Po (1 + 4) 


< 1 for t k > 0 , 


l + Po 4 

The preceding formulas need certain clarification. Since Sk = S k , we obtain 
115*11= sup \(S k x, A-)| , 


By virtue of the relations J 1 E < A < j 2 E we find that 

( T k 7i - 1) E < T k A - E < (T k 7 2 - 1) E , 


which are followed by 


Tk 7i - 1 = - 


Po (1 + ffc) 

1 + Po tk 


T k 7 2 ~ 1 = 


Po (f - 4) 

f + Po 4 
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upon substituting 

T k - 1 ,°. > r o7i = 1 - Po and t 0 j 2 = 1 + p 0 . 

1 + Po l k 

From such reasoning it seems clear that || Sk || = T k j 2 — 1 for t k < 0 and 
II Sk || = 1 — T k j l for t k >0. If t k < 0 and k > k 0 , where k 0 is the minimal 
number for which t k < 0 and p : ( 1 + 2|t fc |) > 1, then 

|| Sfc+i || > || S k || >1. 

This provides enough reason to conclude that 

n 

n ii5,-ii>ii5 to ir io >i 

j=k 0 

and rounding errors in specifying y k will grow with increasing k from k 0 
to n. 

Let ^ = — <C 1 , so that p 0 — 1 — 2^ + 0(<J 2 ) and t ki = cos 2 k 2 l ~ 1 7r < 0. 
7 2 

All this enables us to deduce that 


'5'fci 


Po (1 + I^J) _ 1 + I^J [ 1 ocfi , 1 

1-Pol^l “ 1-I4J \ H 1-I4J 


+ 0 (^ 2 ). 


Under the assumptions | t k | > 0.5 and ^ < 0.01, we might have 


II Ski || = 3 (1 — 6£) + 0((_ 2 ) > 3 ■ 0.9 = 2.7, 

n 

n II Sj II >2.7"-*U 

j=k'l 

As a matter of fact, formulas (30)—(31) express the stability of scheme 
(14) with parameters (29) with respect to the initial data. Those ideas 
supported by the preceding calculations provide proper guidelines for the 
further stability analysis of computational procedures with respect to the 
right-hand side as well as with respect to the initial data in passing from 
y 0 to y k for any k = 1,2,... , n. From the general stability theory outlined 
in Chapter 6, Section 1 we recall that stability with respect to the right- 
hand side is a corollary to the uniform stability with respect to the initial 
data, meaning stability in the process of moving from any y^ to any y k with 
k > j > 0. 
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7. Re-ordering of iteration parameters. With regard to scheme (14) one 
interesting problem arises in connection with re-ordering of the iteration 
parameters {r k } so as to minimize as much as possible the influence of 
rounding errors and to avoid large intermediate values dependent on n. 

The main goal of subsequent considerations is to constitute a “stable 
collection” M n of parameters t 1 , r 2 , .. . , r n for which scheme (14) becomes 
stable and then show the way this result is used in practical implementa¬ 
tions. We improve our chances of ordering the set 

~ {-cos/?;, p i = ^-d n (i), i= l,2,...,nj 
if a sequence of odd integers will be available such as 


K = { 0 n(!)> S n(‘ 2 ), ■■■ , S n( n )} > 1 < S n( 0 < 2« - 1 , 

for i = 1,2,... , n . 

With the aid of its members the parameters {r k } are calculated by the 
formula 

(43) r k = -- a k = -cosfir-^^)] > k = 1,2,. .. ,n . 

l + />oTt l2n 

Thus, the further composition of the set consisting of n numbers 8 n may 
be of help in achieving these aims. 

The traditional tool for carrying out this work is step-by-step transi¬ 
tions from the sets 9 m to the sets d 2m and from the sets d 2m to the sets 
f? 2 m+i. The intention in this direction is to use the formulas 

(44) 9 2rn (2i - 1) = 6 m (i) , 6 2m (2t) = 4m - 8 2m (2i - 1) , 

t = 1 , 2 ,... ,m , 

or, what amounts to the same, 

(45) 9 2m (2i-l) = 9 m (i), 6 2m (2i) = 4m + 2 — 9 2m (2i — 1), 

i = 1,2,... ,m 

for the first operation in passing from the sets 6 m to the sets 9 2m with 
placing the extra, member 9 2m+l (2m + 1) for the second one in passing 
from the sets d 2m to the sets 8 2m+l : 

(46) S 2m+l {i) = e 2m {i) , i = 1,2,... ,2m, 


®2m + l( 2rn + 1) — 2m + 1 ■ 
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When n = 2 P , where p > 0 is an integer, 9 n is found by successively applying 
formula (44) for m = 1,2,... , 2 p ~ l with the starting point 6 1 = {1}. 

Before taking up the general case, we give below the final result of 
this procedure for n — 16 = 2 4 

= {1.3}, 

0 4 = {1,7,3,5}, 

9 S = {1,15,7,9,3,13,5,11} , 

d 16 = {1,31,15.17,7,25,9,23,3,29,13,19,5,27,11,21} . 

When moving from 9 m to 9 2m , the member 9 2m (2i) — 4m — 9 m (i) stands 
on the right from the member 9 m (i) by the approved rule (44). 

Among other things, we may attempt an arbitrary positive integer 
n > 0 in the form 

n = 2 kl +2 i2 + ... + 2 fci , 

where t > 0 is an integer, k i > are integers such that k { > k j+l + 1, 
i = 1,2,. . . , t — 1, and k t > 0, constitute a new sequence of odd integers 

(47) nj = j2 2 k '- k >, j = 1,2,... n 1 = l, 

i = 1 

and then set n t+1 = 2n+l, which formally corresponds to the value k t+1 = 
— 1. It follows from the foregoing that 

- [ = 2 k J -k J + 1 -2 

4 J 

In terms of how rij +1 may be affected, some of the possibilities of interest 


1) Vj = kj — kj +1 > 2 , that is, n - +1 = 2+ 1 , 

2) r ; - = kj — kj +l < 2 , that is, r ; - = 1, n ; - + 1 = 2 n - + 1 . 

The algorithm of obtaining the ordered set 9 n is mostly based on the 
approved rules for the transition from the sets 6}^ to the sets $„ J+1 ■ Having 
formed the set , the differences are sought in two ways: 

(1) if Tj > 2, then the chain of the available sets 
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does follow (44) in conformity with the values m = rij ,2n •, . .., 
2Since iij + l = 2 r -’rij + 1, the set is described by 

formula (46) under the condition 2 m = 2’' J rij ; 

(2) if Vj = 1, that is, rij = (n^- +i — l)/2, then the set 0 2 n, is given by 
formulas (45) and the set 8 n . +i = 0 2n . +1 is line with formulas 
(46). After that, we are moving from $ nj+1 to S„ j+2 , etc. 

Starting from j — 1 with n 1 — 1 and = 6 1 = {1}, we proceed to 
calculations by a. number of different formulas: if k t = 0, then n = n t is 
an odd number and the computations must terminate for j = t — 1 upon 
receipt of formulas (46); if k t > 0, then n is an even number such that 
n — 2 k, n t and n t+l = 2 n + 1. Since k t+1 = —1, we employ r t > 2 and 
formulas (44) in passing from 6 nt to 6 n for the values 

m = n t , 2 n t , . . . ,2 k ‘~ 1 n t = | n. 

We will elaborate on this later for several particular cases. In con¬ 
clusion it should be noted that formulas (44) must be used 2 r - , ~ 1 times as 
opposed to a single application of formulas (45) with the accompanying 
formula (46). Thus, the algorithm is completely described. 

Example 1 Let n = 90, n = 2 6 + 2 4 + 2 3 + 2 1 , that is, k 1 = 6, k 2 — 4, 
k 3 = 3, k 4 = 1; nj = 1, n 2 = 5, n 3 = 11, n 4 = 45; i\ = 2, r 2 = 1, r 3 = 2. 

The chain of describing sets is designated by the symbols 


W 1 w 2 m S ^10 mi 17 22 w i4 ^45 90 i 

leading to 8 n = d 90 . Here d 2m for m = 5 refers to the set specified by 
formulas (45) in contrast to the others 8 2m . The transition to the next 
member of that chain can be done using formulas (44), (45) or (46) as 
suggested before. 

Example 2 Let n = 25, n = 2 4 + 2 3 + 2°, that is, k l = 4, k 2 = 3, k 3 = 0; 
n 1 = 1, n 2 = 3, n 3 = 25; r 1 — 1, r 2 = 3. The sets 


U 1 > u 2 > U 3 t u 6 > U 12 t u 24 *■ a 25 

constitute a perfect chain for the purposes of the present section. 

Summarizing, the preceding algorithm is showing a way of obtaining 
the ordered set of n zeroes of Chebyshev’s polynomial T n (t) and a stable 
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collection in a certain sense of the parameters , r n specified by 

formula (43). In what follows the set so formed is denoted by 


■ M ’* = < '“ COS 


Scheme (14) with new parameters 


i = 1,2, 


---, ai = — cos f — 6* (k) I , k — 1,2 .. n . 

1 + P 0 <tJ \ 2n nK } >’ ’ ’ ’ 


possesses the property of computational stability. Assuming that the effect 
of rounding errors is equivalent to possible perturbations of input data: the 
initial approximation, the right-hand side and the operator A involved in 
the iteration scheme (14). Under such an approach a numerical solution y k 
of problem (14) c.a.n be treated as the exact solution of the problem 


Vk+1 yk +Ay k = f k+1 + 1 


T k +1 


! k +1 


T+ 1 , & = 0,1,2,... ,n. 


In this context, it. should be noted that the member u k+l covers the error 

of —*—%■ 

T k +1 

When possible perturbations of the operator A are neglected for one 
reason or other, the intermediate solutions y m turn out to be bounded in 
norm: 


< £ 11 % 


+ 1 + 


“ max || fi 

Tl l< 2 <m 


- max \\lo: 

l<i<m 


where c m = 1 if m yf 2 P ; c m = 0 if m = 2 P and the error z n = y n — u of n 
iterations satisfies the estimate 


\y n - m || < 11 % - u\ 


1 - q, 

7i 


max 

1 < i < n 


Wfi 


f 11 + 


4 

-= max 

3 -\/£ l<i<n 


The derivation of these estimates espressing computational stability of iter¬ 
ative methods with optimal sets of Chebyshev’s parameters {rj(} is omitted 
in the present book. In the sequel we involve only the collection {t^}, allow¬ 
ing a simpler writing of the ensuing formulas without concern of symbols 

The results of calculations for the example from Section 5 through 
the use of the explicit scheme (14) with ordered sets of parameters {r^} are 
presented in the Table 5. 
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Table 5 


k 

1 

4 

5 

6 

8 

9 

A k 

39,6 

4.7 

7.4 

3.2 

1.1 

6,7 

k 

10 

16 

17 

18 

24 

25 

A k 

3,2 

0,2 

3.1 

1.5 

0,1 

0,8 

k 

26 

32 

33 

34 

48 

49 

A k 

0,1 

0,04 

0,3 

0,14 

1,5 ■ 10“ 3 

1,3 ■ 10“ 2 

k 

50 

56 

57 

58 

59 

60 

Ak 

6,7 ■ 10 -3 

2,2 ■ 10 -4 

1,5' 10 -3 

7,2 ■ 10 -4 

6,5 ■ 10 -4 

1 

O 

CN 

k 

61 

62 





A k 

1.1 ■ 10 -4 

OO 

^3 

O 

1 






In that case we are looking for a solution to the system of equations 

v(^i-i) - 2 H^) + v(z£+i) = 0 , 
x t = ih , i = i, 2, .. . , N — 1 , 

/i = 1 /N , u(0) = 1 , u(l) = 0 , 

under the following conditions: At — 1 = 19, £ = 10 -4 , n — 64 = 2 6 . The 
chain in question 


U 1 r m ^8 ^16 

is constituted in agreement with formula (44) and it reveals a nonmonotone 
character of convergence of the iterations. True, it is to be shown that 
during the transition from the fcth iteration (k = 4 j) to the (k + l)th 
iteration (k + 1 = Aj + 1) the error of approximation Aj. = || y k — yk-i\\ c 
is being increased and, after this, is held down in passing to k = 4j + 2, 
4 j + 3, 4j +4. 
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10.3 THE ALTERNATIVE-TRIANGULAR METHOD 

1. Seidel method. As we have mentioned above, implicit schemes are rather 
stable in comparison with explicit ones. Seidel method, being the simplest 
implicit iterative one, is considered first. The object of investigation here 
is the system of linear algebraic equations 

(1) Au-f 


E a ij u j = ■; = i,2,... ,iv, 

t=i 

with nonzero diagonal elements ci H yf 0. When this is the case, the iterative 
method ascribed to Seidel amounts to 

i N 

( 2 ) Y1 % k Vj + a ij Vj - £•> a ii ± 0 > 

;=1 j=i +l 

f, 

where y. is the k th iteration. Furthermore, starting from i = 1, the 
(k + 1)th iteration is to be formed in line with 

N 

a ii k Vi + “l; Vj = /l > a n ^ 0 . 

;= 2 


giving k y k . At the next stage, knowing k y k and setting i — 2, we find k y^ 
from 

N 

k + 1 * + 1 , V'' fc n 

a 2l Vi + °22 i /2 / j a 2j Vj — /2 ' a 22 r U ■ 

f=3 

The matrix A rearranges itself as a sum 

(3) A = A~+A+ + D, 

where A~ is a lower triangle matrix with zero elements on the main diag¬ 
onal: A~ = (a~.), ar. = for j < i, ar. = 0 for j > i; A+ is an upper- 
triangle matrix with zero elements on the main diagonal: A + — (alb), 
at — a^j for j > i, at. = 0 for j < i, and, finally, D is a diagonal matrix: 
D = Here 6 i} - stands, as usual, for Kronecker’s delta: 6^ = 1 for 

j = i and 6^ = 0 for j yf i. 
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Within these notations, Seidel method can be written as follows: 

(4) (A~ + D) k y L + A + y = / , y = (y 1 , y 2 , ... , y N ) ■ 

Alternative forms of such a two-layer scheme are 

(A~ + D) ( k y l - y) + (A~ + D+ A+)y - f 


and 


(5) (A + D) ( k t/ -y) + Ay = / . 

Further identification with the preceding canonical form reveals 

( 6 ) B V ~ V + Ay = f, k = 0,l,... ,n- 1, yeH, 

T k +1 

with B = A~ + D and r k = 1. This scheme is certainly implicit. The 
matrix B concerned is triangular and, hence, it is not symmetric, because 
the operator is non-self-adjoint: B ^ B*. 

On the basis on the model problem 

Ay — —‘P , x 6 cj h , y\ lh = 0 , 

arising from Section 2 , Seidel method acquires the form 

fc + l fc + l fc + l k k ,, 

y ii- 1 + z/i 4 y + y il+i + y t2+1 —-h“(p, 

so that 

k -\-1 fc + 1 k k 0 

/yx fc + 1 _ 2/ n-1 + 3/ Z 2 — 1 + U'l + l + ^2 + 1 + 

' ' 2 / — 4 

In such a setting it seems reasonable to begin operations at the node 

£_|_ 1 £ _|_ 1 

i 1 = 1 , i 2 = 1 in terms of known values y ,• and j/ and the right- 
hand side of (7) at the boundary nodes (0, 1) and (1,0). With knowledge 

k | 1 k j l 

of y at the node i 1 = 1 , i 2 = 1 the values y are yet to be determined 
along the lower row by setting =2,3,... for i 1 = 1 with further transition 
to the rows with i 1 = 2,3,.... During the course of Seidel method it is 

A; +1 

possible to get the values y at all grid nodes. 
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On account of the basic theorem proved in Section 1 of the present 
chapter Seidel method converges if the operator A is self-adjoint and posi¬ 
tive. More specifically, the sufficient stability condition (11) for the conver¬ 
gence of iterations in scheme (3*) with a non-self-adjoint operator B takes 
the form 

( 8 ) B 0 - ^A> 0 . 

Within the framework of Seidel method we thus have B = A~ + D, r = 1 
and 

B 0 = ± [(A" + D) + {A~ + £>)*] = | {A~ + A + + 2 D), 

since A + = (A - )* and D* = D > 0 in light of the properties of the operator 
A: A — A* > 0. With this in mind, condition ( 8 ) becomes 

B o - T -A=Bo- l -A>0= l -D>0, 

thereby justifying that Seidel method converges with the rate of a geometric 
progression. 

2. The upper relaxation method. In order to accelerate the iteration 
process in view, we are forced to revise Seidel method by inserting in (5) 
the iteration parameter u> so that 

(9) ^4“ + j D^j (S/ 1 -y) + A 11 = f ■ 

This method falls within the category of relaxation methods and gives rise 
to Seidel method in one particular case where ui = 1. In the modern 
literature the iteration process (9) with ui > 1 is known as the upper 
relaxation method. 

By comparing of (9) with ( 6 ) it is easily seen that 

B = A -\ - D , T k = 1 

u> 

or, what amounts to the same, 

B — lo A~ + D , r k = Ld . 

As far as a non-self-adjoint operator B is concerned, the workable procedure 
reduces to inversion of a lower triangle matrix. 
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As shown above, Seidel method is quite applicable for any operator 

A = A* >0. However, the extra restriction 0 < ui < 2 is necessary for 

the convergence of the upper relaxation method. This is certainly true 
under condition ( 8 ) with a known operator B q. Along these lines, it is 
straightforward to verify that B = u> A~ + D, r k = ui and 

Bq = 4 ((w A + D) + (u> .4 + + D)) = (ui A + (2 — w) U) . 

This supports the view that 5o > 0 for 0 < w < 2 and condition ( 8 ) is 

fulfilled for ui < 2 , since 

B 0 --A = B 0 --A = D > 0 for w < 2 . 

u 2 J 2 2 

But the convergence rate depends on the parameter u>. However, there are 
analytical estimates for ui and the convergence rate when the subsidiary 
information on the spectral bounds of the operator D~ l (A~ + A + ) is avail¬ 
able, but their determination is some problem in itself. Just for this reason 
the parameter ui is so chosen as to minimize the total number of iterations. 
In dealing with numerous similar problems this approach is more convenient 
and effective. 

By appeal once again to the model problem of interest it is plain to 
show that the upper relaxation method is a perfect tool in such matters, 
since the work and storage require 



3. Implicit iteration schemes. Convergence of implicit iteration schemes 
was the subject of investigation in Section 2 for the special case 

(10) -— + A y k ~ f , y 0 6 H given, 

T k + 1 

when the iterations can be immediately found by the formula 
Vk+i =Vk~ T k+\(A y k - /) • 

As a matter of fact, the upper relaxation method and Seidel method 
are nothing more than the implicit scheme (6) with B ^ E incorporated. 
Still using the usual framework of implicit iterative methods, the value t/ fc+1 
is determined from the equation 


( 11 ) 


Vk-(-1 — Fk, 


Fk = B y k - T k+1 (A y k -f), 
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with a known right-hand side Fk- In both cases the matrix B falls within 
the category of triangle matrices, since B = A~ + D and B = A~ + — D do 
arise during the course of Seidel and upper relaxation methods, respectively. 
Due to this property every new iteration y k+ i can be obtained by making 
a minimal number of iterations. For the model problem concerned, the 
number of the necessary iterations is equivalent to the total number N of 
the grid nodes. 

Proper guidelines for the well-founded choice of the operator B are 
provided by the following requirements: 

• a minimal number of iterations; 

• the operator B is economical, the work and storage require O(N). 
The meaning of the latter property for difference second-order equa¬ 
tions of the elliptic type is that the equation By k+1 = F\ with a. 
known right-hand side Fk must be solved in a minimal number of 
operations. 

The main result in Section 2 regarding the optimal set of parameters 
{r k } can be generalized directly for implicit schemes with B ^ E as follows: 

B -— + A y k = f , k = 0,1,... , n - 1 , y 0 6 H given, 

T k +1 

under the conditions 

(12) B = B* > 0 , A = A* > 0 , j 1 B < A < j 2 B , •y 1 > 0 , 

whose key role is to specify the primary family (6) of iterative methods 
at the very beginning. But this is not the case for the upper relaxation 
method and Seidel method both in connection with the property that the 
operator B is non-self-adjoint: B ^ B*, 

In mastering the difficulties involved, the intention is to use the ho¬ 
mogeneous equation related to the correction w k = B~ 1 (Ay k — /): 

(13) B - - + Aiu k =0, k = 0,1,... ,n - 1 , 

T k +1 

w 0 = B~\Ay 0 - f) E H given. 

The preceding scheme is equivalent to the explicit scheme 

— ---- + C x k = 0 , fc = 0, 1,... , n — 1 , x 0 6 H given, 

T k +1 


( 14 ) 
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where x k — and C = B~ 1 ! 2 AB~ 1 ! 2 . 

Indeed, because the operator B is self-adjoint and positive: B = B* > 
0, the square root B 1 ! 2 does exist with the property 

(B 1 * 2 )* = B l/2 >0. 

By applying the operator B ~to equation (13) and inserting w k = 
B~ l ! 2 x k we arrive at scheme (14). Arguing in reverse order we might 
obtain the same result without any difficulties. 

Lemma 1 Given operators 

A = A* > 0 , B = B* > 0 , C = B~ 1,2 AB - 1/2 , 
the operator inequalities 

(15) 7iB<A<j 2 B, p 1 E < C < j 2 E , 7 i > 0 , 
are equivalent. 

Proof A reasonable form of the functional at hand is 

i = U A - 7 B ) y, y) = ( A y, y) - 1 (B y, y) 

= (AB- 1 l 2 {B l l 2 y) ) B- l l 2 (B i l' 1 y)) -7 (B l/2 y, B 1/2 y) 

= (C x , a:) - 7 (x, a:) = ((C - 7 E)x, x) , 

where x — B l ^ 2 y is an arbitrary element of the space H due to the arbi¬ 
trariness in the choice of the element y 6 H. Because of this, the equality 

(16) I = ((A - 7 B) y, y) = ((C -7 E) x, x) 

implies that the operators A — 7 B and C — 7 E are of the same sign. For 
the sake of simplicity we may assume A — p 1 B > 0 and then insert j ~ j 1 in 

(16) , leaving us with the inequality I = ((C — 7 1 E) x, x) > 0. This means 
that C >j 1 E, etc. Thus, the assertion of the lemma is completely proved. 

From what has been said above another conclusion can be drawn in 
this direction: the possible applications of the implicit scheme ( 6 ) in solving 
the original equation An = / are equivalent to the numerical solution of 
the auxiliary equation C'v = ip through the use of the explicit scheme 

(17) fc+1 -- + C x k = (p , k — 0,1,... , rz, x 0 6 H given, 

T k + l 

if we accept C = B~ 1 ! 2 AB~ 1 ! 2 and <p = B~ 1 / 2 f. Under this agreement 
all the results obtained in Section 2 for a particular implicit scheme can be 
covered by the following statement concerning explicit schemes. 
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Theorem 2 Let conditions (12) hold. Then an optimal set of parameters 
{r fc } specified by formulas (27)-(29) exists and may be of assistance for 
solving problem (6), providing the validity of the estimate 


(! 8) \\ A Vn -/IIb- 1 < q n \\ A y 0 - /IIb-i 

with 


(19) 


Qn 


1 + p 2n 



c 




7i_ 

7? 


Recall that Theorem 2 has been proved in Section 2 placing a spe¬ 
cial emphasis on one particular case of explicit schemes with the identity 
operator B = E involved. To make our exposition more transparent, the 
implicit scheme transforms into the explicit scheme (17). Having stipulated 
the conditions < C < 7 2 ff, the estimate 


( 20 ) II Cx n - A\\ < In || C X o - A\\ 

is an immediate implication of estimate (31). The forthcoming substitutions 
p = B~ l ! 2 x n — y n and C = B~ 1 ! 2 AB~ 1 ! 2 may be useful when 

providing current manipulations: 

II C x„ - p || 2 = {C x n - p, Cx n - p) 

= (b- 1 I 2 {AB~ 1 I 2 x n - x n - /)) 

= {B-\ A y n -f),Ay n -f) 

= \\ A Vn-f\\ 2 B -i- 

By inserting \\Ay n — in (20) in place of the norm ||Cx' n — p\\ we 

arrive at inequality (18), thereby completing the proof of the theorem. 

In concluding this discussion it is worth noting that the type of the 
original equation Au = / and the operator B have no influence on a univer¬ 
sal method of numbering the parameters Tj, . . . ,r n that can be obtained 
through the use of the ordered set Ad* of zeroes of Chebyshev’s polynomial 
of degree n, whose description and composition were made in Section 2 of 
the present chapter. 
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4. The alternative triangle method. Making a substantiated choice of the 
operator B will be justified in more detail a little latter. Recall that any 
product B of “economical” operators is also an “economical” operator. This 
is certainly true for “triangle” operators Bi and B 2 for which the operator 
B = B\B'j would be “economical”. 

Any such operator R = R* > 0 is representable by 

(21) R 1 + /?2 = R , R = R* > 0 , R* = R r 2 , 

where R\ and R 2 are “triangle” operators. The associated matrix 72 = (r i; ) 
is symmetric, that is, = r^-. It is obvious that the appropriate matrices 
72-1 and 72-2 are given by: 


72r =(-)), 

^2 = (r+), 


f r tj for j < i , 

| 0 for j > >, 

f 0 for j < i ., 

1 r {j for j > i , 


From here and the symmetry condition = r ; - t - it follows that 72j = 722. 

The operator B built into scheme (6) arranges itself as a product of 
“triangle” operators: 


( 22 ) 


B — (if + ui R \) (E -|- io R 2 ) , 


where ui > 0 is a numerical parameter. One succeeds in showing that B 
is a self-adjoint positive operator: B = B* > 0. Due to these properties 
scheme (6) with operator (22) will belong to the primary family of schemes 
( 12 ). 

Indeed, it turns out that the operators 


Bi — E + ui R\ , B'j = E + ui i?2 


are adjoint and positive: 

B\ — {E + w Ri)* = E -\- ui i?2 — B2, Bi > E , B2 > E for ui > 0 , 
since R r > 0 and R 2 > 0 : 

(Ry, y) = (Ri y, y) + (R2 y,y) = 2 (Ri y, y) = 2 (R 2 y, y) > 0 . 
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This implies that 

(y, BiB 2 v) , 

II Bn y || 2 > 0. 

It seems clear from the equation 


(By, v) = (B ! B 2 y, v) = (y, B 2 B\ v) = 
meaning B = B*. By the same token, 

(By, y) - (Bi B 2 y, y) = (B 2 y, B 2 ,y) = 


( 23 ) (E + LoR 1 )(E + LoR 2 ) yk+1 tJk + Ai Jk = f, k = 0,\,...,n, 

T k +1 

given y 0 6 H , 

that the value remains as yet unknown and can be found from the 
equation 

(E + u) Ri) {E + io R 2 ) y^+i = Ft 

with the right-hand side Fk = By k — r k+1 (Ay k — /). 

As a matter of experience, by solving successively two equations 

( 24 ) (E + io R\) y = F k , (E + u> R 2 ) y k+i = y 

with upper and lower triangle matrices we get a final result. So, the title and 
origin of the alternative-triangle method (ATM) owe a debt to scheme 
( 23 ) with operator ( 22 ) that can add interest and help in understanding of 
how one could progress in this direction. Before going further, we need to 
know the values of parameters 7j and j 2 . 

Lemma 2 Let operators R, Ri and R 2 be in line with the conditions 

R = R\ + R'j, R 2 = Ri a nd 


(25) R=R*, R>6E, 6> 0, 

A 

(26) R 1 R 2 <jR, A>0. 
Then the estimates are valid 


0 


0 


( 27 ) 


71 B < R < 7 2 B 
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wi th 
(28) 


7, = 


1 1 +W $ + I W 2 5A ’ 2 2w’ 

where an operator B is specified by formula (22), The ratio 


7:(u 


l 2 {u 


attains its maximal value for 
(29) 

giving in that case 

2 \fh 


y/6 A ’ 


(30) 


£ 


6 

A ’ 


1 + v^? 

Proof Inequalities (25) and (26) together imply that 

(Ry,y) > Hv,y ), 


2(1 + \fh) 72 4 ^fj- 


(RiRn-y,y) = {R?y,R\y) - \\Riy\\ 2 < j(Ry,y), 

whence it follows that 6 < A and i] < 1. 

Before giving further motivations, we may attempt operator (22) in 
the form 


(31) B = E + to (R\ + R 2 ) + io 2 Ri R 2 = E + lo R + lo 2 Ri R 2 , 

With the relations R > 6E or E < jR in view, we obtain for the operator 
B the upper estimate 


B < -R- 

0 


R- 


R 


R = 


R, 


yielding the relation R > 7 1 B. Formula (31) transforms into 
B = E — lo (Ri + R 2 ) + ui 2 R\ R 2 + 2lj {Ri + R 2 ) 


= (E — ui R[) (E — lo R 2 ) + 2 ui R 
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when performing current manipulations with the operators B and R: 
(By,y) = ((E - u Rl) (E - u R 2 ) y, y) + 2c j(Ry,y) 

= ((E -ui R 2 ) y,(E ~ui R 2 ) y) + 2c j ( Ry,y ) 

= \\(E -uj R 2 )y\\ 2 + 2uj(Ry,y) 


> 2 c o(R y, y) - -^-(Ry, y) . 

7 a 

0 

From such reasoning it seems clear that ( Ry,y ) < 7 2 ( By,y). 
The next step is to find a maximal value of the ratio 




2c o 6 


° 1 +lj6 + (lj 2 6 A)/4 


by observing that 


= 26 
dui 


2 6 A/4 


l+u+ + (ca 2 dA)/4) 


2 ' 


From calculus it is known that the maximal value of £ (w) is attained for 
2 0 

ca = ca 0 = - ~f =— , since £"(w) < 0 for ca = ca 0 , Upon substituting ca 0 = 

v 6 A 

2 y/? 7/<5 into (28) we derive formulas (30). 

Theorem 2 Let under the conditions of Lemma , 2 the inequalities 
(32) c 1 R < A < c 2 R, Cj > 0 , 

hold simultaneously for operators A = A* > 0 and R = R* > 0, Then for 
ATM given by formula (23) with optimal set of Chebyshev’s parameters 

2 1 -£ 


(33) 


1 + Po a k ’ 


7i +7 2 


Po ~ 


_ £ = li. 

1+V * 72 


0 0 0 (5 0 S 

7j = Cj 71, 72 = c 2 7 21 71 — 7-72 ■ 2=7-, 7 2 — 


2(1 + v^) 


4-yV 


<5 

A ' 




where 
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estimate (18) is true and it suffices to perform n iterations for the validity 
of the inequality 


\\ A Vn £ W A Vo ^/lls - 1 

where 
(34) 

Proof In complete agreement with the preceding theorem with known co¬ 
efficients 7 j and y 2 , arising from the operator inequalities y 1 B < A < y 2 B, 
we deduce from (27) and (32) that 


> n 0 (e) 


)(0 


1C2 In (2/e) 

Ci 2 \/2 \fri ' 


0 

A > Cj R > Cj 7 j B — 7 j B , meaning 


7j — Cj 7 j , 


0 

A < c 2 R < c 2 7 2 B = 7 2 B , meaning 


0 

I 2 ~ ( h f 


The conditionality parameter for cj = cj 0 is equal to 


£_7L_£i£_£i 2 V^ 

T2 ^2 ^2 ^ “I - Vv 

Theorem 2 and the results of Section 2 apply equally well to such a setting. 
As stated in Section 2, the condition q n < e is ensured by n > In — J (2\/£). 

c 

Substituting here £ = 7 j/ 7 2 and taking into account that £ < —2-Jrj, 

G 

we derive the sufficient condition (34), which can easily be verified in one 
particular case of interest: 


A =/? = /?!+ R, 2 , R *2 = R\, Cj = c 2 = 1 , 

The total number of iterations required in this connection is no less than 

^ 2 N , j ln ( 2 /e) 

" - n " (£) ■ ”" (£) = yym■ 

5. ATM for the difference Dirichlet problem. The trace of those ideas can 
clearly be seen in tackling the difference Dirichlet problem associated with 
Poisson’s equation in the rectangle G = {0 < x a < l a , a = 1,2}: 

(35) A y = y SlXl +y S2X2 --f(x), x £ u> h , y\ lh -p{x). 
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Here the composition of the grid is 

Ljfo — i — '■'2^2)1 ^ a 0,1,2,,,, , N a , N a h a — l a , cv — 1,2} 

= U y h , 

where j h is its boundary, In that case 

A ty= -Ay , y 6 H = , 

/f=yl, Riy = y s jK +y s Jh 2) R 2 y = -y x Jh l - y x Jh 2 , 
and instead of (35) we obtain 
(35') A y = <p , yeO, 

where the right-hand side (p differs from the function / only at the near¬ 
boundary nodes, Simple algebra gives 



Here we should take into account that 


(dj + a 2 b 2 ) 2 < ( a 2 + a" 2 ) ( b 2 + b 2 ) 

and 

(Ry, y) - {y 3ll , y :El ] i + (y £ . 2 , 2 > || y Xl || 2 + || y x . 2 || 2 
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under the inner product structure 


N i w 2 -i 

Ki'L 2 v i,i 2 h i h 2 ■ 

i 1 = 1 i 2 = 1 


The inner product (u, v] 2 can be introduced in a similar way. 

Knowing 6 and A, it is not difficult to determine the values of 77 , ■y 1) 
j 2 and £ and, after this, to estimate the number of the iterations required 
in such matters. 

Available data processing is a special starting procedure in the further 
comparison of three methods in line with established priorities by having 
recourse to the model problem (35) that we have set up on a square grid 
h 1 = h 2 = h in the square G with the unit sides (/j = l 2 = 1), Plain 
calculations show that 


. 2 it h 

77 = sin -, 

1 2 


_ 2 Vv 

1 + ^? 


2 Vv- 


7 r h 

2 sin -, 

2 


For small values y < 1 we might have 


v^2 \frj k, \J 7r h w 1.77 \fh , 

n 0 ( £ )«^ln-=^ for £ = 2 e " 10 « 1 (T 4 , 

W yfh £ \fh 

The first criterion among others is the number of the iterations in the 
following three schemes: 


h 

SIS 

SCP 

ATM 

1/10 

200 

32 

9 

1/50 

5000 

160 

21 

1/100 

20000 

320 

29 


We present below the algorithm of finding the (fc + l)th iteration from 
the equation 


B y — (E + l o 0 R\) (E + co 0 R 2 ) y — F > 

F - By - r k+1 (A y - ip) = By + r k+1 (A v + f ) , 


( 38 ) 
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with the supplementary conditions 


k + l k 

y =y 


0 on j h , 


k 

V 


— y for x G ^ hy 


k 

V 


= ^ for ® G 7ft ■ 


A .solution k y 1 of problem (38) on + 7 ft can be obtained through the use 
of such a procedure: k y 1 — y on ui h and G 1 =/J on j h . The recovery of 

£ _l_ ^ 

y requires successive solution of the problems 


(39) 
where 

(40) 


k £_|_ 1 

{E + ui 0 Ri) y = F < (A + lj 0 R 2 ) y 


Ri y 


y - Vi x -\ , y~v i2 -1 


hi 


hi 


x 6 u h , 


1 


1 


A? h'i 


1 1 

+2 Vii-l + Vi 2-1 


(41) 


R2 y 


y tl+ i - y Vi 2 +1 - y 






1 1 \ /1 1 

K> + Vj V ~ ^ + Ap 1 '^ 1 

In preparation for this, we have at our disposal 

y = y(i 1 h 1 , i 2 h. 2 ), Vi,±i = y((h±i)h it i 2 h 2 ), Vi 2 ± 1 = y(h h i, ih±i)h 2 ). 


The operator E+ui 0 Ri is specified on a three-point pattern (q h l , i 2 h 2 ), 
((?!j — 1) h 1 , i 2 /i 2 ), (ij Aj, ((i 2 — 1) /i 2 ), while the operator E + lo 0 R 2 _ on 
a three-point pattern (i 1 h 1 ,i 2 h 2 ), ((i 1 + 1) h 1 , i 2 A 2 ), (ij Aj, ((i 2 + 1) A 2 ). 
Upon substituting the above expressions for iZj y and R 2 y into (39) we 
establish the recurrence relations which will be needed in the sequel: 


(42) 


x i Vi!-! + x 2 y% 2 — 1 + f 

1 ~\~ X\ ^2 


y\ lh = 0 , 


k+l fc+1 

k+i Xj y il + 1 +x 2 y i+l +y fc+r 

y — -—-—- 

1 ~\~ ^2 


y 1 i h = Q -- 


^ = H *=hi 


(43) 
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giving the values y and y at the centre (ij h y , i 2 h, 2 ) of the suitably chosen 
pattern. 

Further development with y on the grid Lo h is due to a special choice of 
the near-boundary node i x = 1 , i 2 = 1 at the left lower corner of the domain 
of interest so that two other nodes ((i 1 — i 2 h 2 ) and (ij h 1 , ((i 2 — 1 ) h 2 ) 
should belong to the boundary on which the values y, i and y i _j are 
already known. Formula (42) gives the value y with further contingency 
either along rows or along columns. 

The directions of row account are from the left to the right: for fixed 
i 2 — 1 we are moving from i l — 2,3,.,. to i i = N i — 1 and, after this, 
for fixed i 2 = 2 - from ij = 1,2... to ij = Ni — 1. The directions of 

column account are bottom up. The value y depends on "y ii + 1 and 

fc _|_ -y 

V 2 ' 2 _|_i, therefore account starts at the right upper corner of the domain: 
jj = N\ — 1 and i l = N[ — 1, so that two adjacent nodes should belong to 

the boundary on which the values y and y are already known. 
Further calculations are performed either along rows (from right to left) or 
along columns (from top to bottom). 

All of the calculations are best conducted by recurrence formulas, 
whose algorithm is certainly stable and is called “through execution” 
algorithm. 

Within its framework it is necessary to perform 4 operations of addi¬ 
tion and 6 operations of multiplication at every node of the grid for determi¬ 
nation of k y with knowledge of p . In giving p 10 operations of addition 
and 10 operations of multiplication should be performed. Summarazing, 
it is required to carry out 14 operations of addition and 16 operations of 

. k k + l 

multiplication m passing from y to y . 

In trying to make these numbers small enough, it is highly recom- 

k 

mended to save two numerical sequences instead of y . This can be done 
using the algorithm 


(44) 


(E + ca 0 Ri)lo = , wl 7 )i =0, 

(E + lo 0 R 2 )ui — Co , w | 7(i = 0 , 


fc+i 

y 


= y + e +i 


fc+r 

Ld 


where <f>r. = Ay + / and v | = y, making it possible to perform 10 op¬ 

erations of addition and 10 operations of multiplication at one node for 
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& + 1 

determination of ji , In so doing the passage from the kt h iteration 

to the (k + l)th iteration necessitates the storage not only for the value 

^ k 

y (i 1 h l ,i 2 h 2 ), but also for the value w (h h 1 , i 2 h 2 ). 

6 . A higher-accuracy scheme in a rectangle. In Chapter 4, Section 5, the 
Dirichlet problem 

(45) An = -/(; x ), x E G , u = y(x ), x 6 T , 

was completely posed, for which the difference scheme of fourth-order ac¬ 
curacy was composed in the following way: 

(46) A'y=-ip(x), xEio h , y = y(x), x E 7 h , 
where 

h 2 + h 2 

Ay = Ay -\ ——^—- Ai A 2 j/, 

A = Ai + A 2 , A tt y = y SaXo , a =1,2, 

h 2 h 2 

r = / + I jA,/ + -A 3 /. 

0 

Let now H = Q be a space of all grid functions given on the grid Q h 
and vanishing on the boundary Having involved the operators Ay = 
—A'y and Ry = — Ay specified for any y E H, we deduce instead of (46) 
that Ay = <p , where ip yf <p only at the near-boundary nodes. Applying the 
estimates obtained in Chapter 4 for the operator A yields 

2 

~R<A<R, 

O 

and reveals the coefficients to be c 1 = | and c 2 = 1. The operator R 
arranges itself as a sum 





Being concerned with the same quantities 6, A and ui 0 a.s in Section 5, we 

0 0 0 0 

might agree to consider = ^7 x and 7 2 = 7 ,, where 7 lt 7 2 were specified 
in Section 4: 

o 6 o S 

7l = 2(1 + ^/y) ’ 72 = VT 
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Knowing and j 2 , it remains to find the iteration parameters {r^} with 
a simple observation that formulas (42)-(43) are still valid with another 

member p : 


k k k k h? + hi k 

(47) F = F (38) + $ , $ = -t>+ l y 2 ~ Al Az y 


where p (3g ^ is given by formula (38). The total number of the iterations is 
equal to 


n > n 0 (e) 


(e) 


3 „ . 

2 ».in 


where n*(e) is the total number of the iterations for the Dirichlet problem 
associated with Poisson’s equation (35). The total number of the iterations 
required in ATM for a higher-order scheme is being increased in \/l.b se 1.22 
times as compared with a scheme of second-order accuracy. 

In the two-dimensional case the iterative alternating direction method 
or the direct decomposition method turns out to be more economical, but 
for the multidimensional Dirichlet problem ATM is the most economical 
one among other available methods. This advantage is stipulated by the 
special structure of the operator A' (see Chapter 4, Section 5): 


(48) A l y—'^A a (E + XpAp), Xp — , 

a = l p = l,p^a 


A a y = y s 


assuring the operator inequalities 


(49) 


2\p-i 

3/ 


R< A < R, 


where 


p 

Ay = -A’y, R y = -Ay = - ^ A a y , y£H, 

a —l 



(p-D/2 


"SCO. 


and n*(e) is the total number of the iterations required in connection with 
solving the equation Ry = f, not depending, in fact, on the number of 
observations p. 
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7. Difference schemes for elliptic equations of general form. As we have 
mentioned above, the applications of ATM in the numerical solution of an 
operator equation of the first kind consist of several steps; 

• determination of the operator R] 

• design of special “triangle” operators Ry and R 2 ; 

• calculations of the equivalence constants c 1 and c 2 and S, A; 

• selection of the number n = n(e) of the iterations and a set of 
parameters {r^}. 

We begin our exposition with a discussion of examples that make it 
possible to draw fairly accurate outlines of the possible theory regarding 
these questions and with a listing of the basic results together with the 
development desired for them. Common practice involves the Laplace op¬ 
erator as the operator R in the case of difference elliptic operators A. The 
present section is devoted to rather complicated difference problems of the 
elliptic type. Here and below it is supposed that the domain of interest is 
a p-dimensional parallelepiped G = {0 < x a < l a , a = 1,2 ,,,, ,p} with 
the boundary T (a rectangle for the case p = 2 ), on which the boundary 
condition of the first kind is imposed: 

«l r = K x ) • 

In what follows it is required to find a continuous in G solution of the 
Dirichlet problem 

(50) Lu = —f(x), x E G , w| r = fi(x), 

with a second-order elliptic operator L involved. 

With this aim, we introduce in the domain G the usual grid 

uq, — — (c^i ) c/i 2 , • • * ) C G, i a — 0 , 1 , 2 ,,,. , N a , 

h a N a = l a , a = 1,2,.,, ,p) 

with the boundary j h , so that A h = ui h Up/,. As usual, an inner product in 
0 

the space H = Cl of all grid functions defined on ui h and vanishing on the 
boundary j h is taken to be 

(y,v) = J2 y(x)v(x)h 1 h 2 ■■ h p . 

UJ h 


It seems worthwhile giving several particular cases. 
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a) An equation of the elliptic type with mixed derivatives. In that 
c.a,se we are agree to consider 


(51) 


Lii — 'y L a pu, L a pu — ^ j 


a,(3~ 1 
P 


(52) Cl £C< Y1 k ap( x )L^P <C 2 J2C 

Qr='l a,/?=l O' — 1 


where £ = (£j,£ 2 , . . . ,£ p ) is an arbitrary vector and c 1 > 0 and c 2 > 0 are 
constants. 

In dealing with difference operators on the grid c o h at hand such as 


(53) Ay 


P 

E 

<*,/?=! 


A «P y, A ap y = - (k af3 y Sp ) + (k aj3 y Sa ) 


we may set up in conformity with problem (50) the difference Dirichlet 
problem 

(54) A y=-p(x), xEw h , y = p(x) , x E j h , 

0 

and follow established practice: introduce in the space H = fi the operators 
A and R acting in accordance with the rules 

p 

0 » 

Ay = —A y , Ry = - A y = - y Vs a x a > 

a=r 

0 

where A is a difference (2 p+ l)-point Laplace operator, and accept instead 
of (54) the governing equation Ay = ip, where ip ^ p only at the near¬ 
boundary nodes, Recall that 

(55) Cj R < A < c 2 R , 

where c l and c, are constants arising from the ellipticity condition (52), 
By analogy with Section 5 the operators R\ and are specified by 
the formulas 


p 

R\y=Yl 

C(—\ 


ih. 


R-i y 


y Vja 
^ h, 


oe= 1 


Ry + R-, = R . 
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The constants 6 and A remain as yet unknown. Since 6 is the smallest 
eigenvalue, it is not difficult to show that 


* = E 


4 

a 


2 /. 


By virtue of the relations 


\\R2y 


2 


E 


a = 1 




^ E ^ E ll II 2 ^ E ( R y - y) 

a=l a a=l a=l « 


plain calculations permit one to conclude that the constant A is equal to 

p 4 

E with knowledge of S, A, c x and c 2 simple algebra gives ui, n(e) 

a= 1 ' « 

and {r/ }, which constitute what is needed in the applications of ATM, The 
total number of the iterations 


(56) 


n{e) > n 0 {e) = 


/c/~ In (2/e) 

Vg 2 \/2 \fr\ ’ 


is proportional to 

In the case of a cubic grid (/q 
p-dimensional cube we might have 

7T h 

h , *in- -j-, A = 


c 4 P • 2 
o — —— sin 


= h 2 

4 p 

h 2 



= h p = h) in a unit 


, t 7T h 

i) = sin“ 


thereby justifying that the total number of iterations is independent of the 

number of observations, 
k-\-l 

The iteration y is recovered from the equations 

(57) B\y ~ (E + t-oRi) y = p , B 2 y = (E + u>R 2 ) ’y = y , 


(58) F = By - r k+i (Ay - <p) = By + r k+l (Ay + <p) . 

A solution of problem (57) is given by ^i; 1 = y 1 for x 6 l o h and by v = p 

for x E j h , so that k y l — y = y — y. The preceding difference operators 
B] and B 2 can be written as 

/ p i \ p l 

(59) By y ~ y + uj R 1 y = ( 1 + lo ^ — jj/ - ca ^ 

' fx= 1 a=1 Q 

/ p 1 \ p l 

(60) B 2 y - y + uiR 2 y = ll+uj j^\y-u ^ 

' a=l a = l » 
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The calculations start from the corner i, = 1, i 2 — 1, .. ., i p = 1, of the 
parallelepiped of interest for which all of the adjacent nodes x^ la ' 1 E y h 
fall into the boundary ones at which the values = p are already 

known. With knowledge of y at that node we fix i 2 = 1, ,,,, i = 1 
and change i, = 1,2 ,,., , A^i — 1. After that, continuing this process for 
i l = 1,2 ,,.. , TVi — 1 and for fixed i 2 = 2, etc. we find at all the nodes 
x <E io h that 


p 


1 


"E 

a=l a 


;(“ la 


1 + 


A\-1 


Along these lines, the starting nodes i a = N a — 1, a = 1, 2,,,, ,p, suit us 

Jc “|“ 1 

perfectly for determination of y on the grid uj h by the rule 

p 


fc+i 

y 


a = l a ' 


b) A system of elliptic equations. Let u = {u l ,v?, , . . ,u m °) be a 
vector and let a block p x p-matrix k = (k s J^) with blocks of size m 0 x m 0 
will be so chosen as to obtain some suitable matrix k a p = ( k s Q ™) of size 
m 0 x m 0 for later use. The Dirichlet problem for a system of equations is 


first considered 

in the parallelepiped G: 



£ 

II 

~f s , xeG, u s =p s , 

ier, s = i, 2 ,.. 

. , m 0 

where 




(62) 

P m 0 r, 

" = £ X k 

(,sm dum \ 

V dx g ) ' 



In such a setting the condition of ellipticity becomes 

p rn o p mo P m o 

(63) bEE(C) 2 < E E ^wc^'nEEa 2 . 

a = l 5 — 1 a t P—l s,m — 1 a —l 5 = 1 

where ~ ■ • • ,£™°), = 1,2 ,,.. ,p, are arbitrary vectors and 

c i > 0, c 2 > 0 are constants. A reasonable form of the difference operator 
is 

p m 0 

w = E E w 

a,p-l m= 1 


(64) 
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with 



making it possible to set up the difference Dirichlet problem 

(66) A y* = ~if s , x 6 uj h , y s - p s , x <E y h , 

0 

in the space H ~ Q, of all grid functions under the inner product structure 


m 0 


(y. v ) = ' 52 (.y s > vS ) > (y s ,v s )= y s {x) vS ( x )h l h 2 ---h. p , 


5=1 
,1 .,2 


m D \ _ /.,! 2 $ m o ^ 


y = ,y\... ,y m °), v = (G, rC, ,.. , tr\ ,., , u 

y s 6 H , v s E H , s = 1,2,... ,m 0 , 


Being concerned with the operator Ay s = —A y s and the regularize!' Ry s = 
0 0 
— Ay s = ~Y2a=iyl ,■ O e space H, where A is a (2 p + l)-point dif¬ 
ference Laplace operator, we rely in the further derivation on the Green 
formula and condition (63), whose combination gives the operator inequal¬ 
ities (32), Having involved the same operator R as was done in problem 
(53)—(54), we obtain the constant ui and the operator B in terms of known 
members 6 and A, Just for this reason the same algorithm as in a) is work¬ 
able for determination of the (fc + l)th iteration for either of the components 
k 4 " 1 

y s and so it is omitted here, 

c) A system of equations in elasticity theory. The system of Lame’s 
equations arose from the stationary elasticity theory; 


(67) Lu = /iAu+(\ + fi) grad div u = —f(x) 

with vectors u = (w 1 , u 2 , . ,. , u p ) and f = and Lame’s 

constants A > 0 and /.< > 0. We may attempt the preceding system in the 
form 


(6S) f.i -q^t + ( A + f-k 




p =l dx p dx s 


1,2,,,, ,p. 


Further comparison of this with (62) allows us to deduce that 

(69) ^ap = i l &ap C-TO + ( A + h) {>as &pm > 
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where 6^ is, as usual, Kronecker’s delta. 

We learn from Chapter 9, Section 2 that the constants c l and c 2 
involved in inequalities (63) are equal to 

Cj = /i, c 2 = A + 2 p , 

With these, the difference Dirichlet problem associated with (68) is de¬ 
scribed by 

(70) AV = -/', v‘=n‘, vejh, s= i,2,.,., P , 

where 


A 5 y s 


P - P 

= /•* A a y s + (A + fj) A p 8 yP , 

a= 1 p= i 


A a y VxcXc ’ A ps y 2 ivxpx s A V%pxs) • 

The above framework necessitates specifying for any y s 6 H the operator 
Ay s = —A s y s and the regularize! 1 Ry s = — XTa-i A aV s , thereby clarifying 
that the same operator R is adopted for these purposes as before. 

By Green’s formula it is straightforward to verify the inequalities 
Cj R < A < c 2 R with constants c 1 = /./, and c 2 = A + 2y incorporated. 
By exactly the same reasoning as in the preceding examples ATM requires 
n 0 {c) iterations, where 


(71) 


I A + 2 fj, 


y 


and n* (e) is the total number of the necessary iterations in solving the 
Laplace equation, 

8. ATM for solving grid elliptic equations in an arbitrary complex domain. 

Two lines of research in subsequent considerations of such equations are 
evident in available publications in this area over recent years. No much 
is known in the case of an arbitrary complex domain. The first one is 
connected with nonequidistant grids, while the second one deals with some 
modifications of available methods. Even a constant step in each direction 
does not allow to overcome the difficulties in the near-boundary zones as a 
result of emerging non-uniform grids. 

It turns out that the convergence of the aforementioned methods be¬ 
come worse on account of widely varying bounds of the spectra of difference 
operators. 
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Current explanations need certain clarification by having recourse to 
one simplest example devoted to the governing equation 

u" = —f(x ), 0 < x < 1 , u(0) = u(l) = 0 , 

and associated three-point scheme 

(72) Ay = -/(*), xeu h , y( 0) = 0 , y{\) = 0 , 

which is constructed on the grid 

to^ — {."Co — 0, x ^ — h 1 , x 2 — h ^ h , x 3 — 1} , 


so that at two inner points 


Aj/j 


1 

h 


y 2 - lh __ Ih 

h h 1 


A y 2 = 


" 2 y 2 + Vi 
h 2 


since y 0 = y 3 = 0. For clarity only, we take h 1 < h and 2h + hj =1. 

The next step is to find the eigenvalues of the operator A. By defini¬ 
tion, Ay + Xy = 0 or, what amounts to the same, 


1 

h 


y 2 - ih __ ih 

h hj 


+ A j/j — 0 


" 2 y 2 + y 1 

h 2 


+ A t / 2 


= 0 


Having completed the elimination of y 2 , we derive the quadratic equation 
related to y = Ah 2 : 

(73) t /j 2 — (1 + 3t) /r + 2 + t = 0 , t = /q/h , 

with the roots 

1 + 3t i ^(1 + 3t) 2 At (2 t'j ^ _ h(i,2) 

A(i,2) ~ Yt ’ A(1 ' 2 J = ~JY~ 

and the characteristic relation between Aj-j-j = A min = 6 and A(- 2 ) = A max = 
A: 


6 _ 2t(2 + t) 

A ” (1 + 3t) 2 ~2t(2 + t) + (l + 3t) v/(l +3t) 2 -4t(2 + t) ' 


Whence it follows that for t = 1, that is, on an equidistant grid r] ~ 1/3, 
while i] k, 2t = 2h 1 /h for small ratios t = h 1 /h <C 1; making worse the 
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conditionality of the system (72) of equations along with decreasing the 
ratio h 1 /h. 

It seems clear that in solving the system (72) the number of the it¬ 
erations within the framework of the explicit scheme with optimal set of 
Chebyshev’s parameters or of the simple iteration scheme is proportional 
to 1 / y/rj or 1 /i), thus causing an enormous growth as h j —>■ 0. 

The generalized problem on eigenvalues of the same operator A is of 
the form 

Ay + A Dy = 0 , 

where D is a diagonal matrix such that Dy = d{x)y ) d(x ) > 0. In the case 
of interest 

M o 

D = 

\ o d 2 

and the problem of determining A amounts to 


1 f ih ~ V\ 
h V h 


V t) +XdlVl 


2 y 2 + V\ 

h 2 


+ A d 2 y 2 — 0 . 


Instead of (73) we must solve the quadratic equation 


dj d 2 1 jj 2 — [(1 + t) d 2 + 2td x ] fi + 2 + t = 0 . 


For the choice d x — l/t and d 2 = 1 we deduce from the foregoing that 
rj = 1/(2 + t) and i] 0.5 when t, < Cl, that is, rj remains finite as /q —>■ 0. 
From such reasoning it seems clear that the scheme 


(74) D Vk =A y k + f 

T k +1 

offers more advantages in comparison with the explicit scheme. 

A similar situation exists during the course of ATM for solving elliptic 
equations on nonequidistant grids or in arbitrary complex domains, giving 
rise to obvious modifications of ATM with the intervention of the operator 
D = D* > 0 built into the structure of the operator B. Making a substanti¬ 
ated choice of the operator D is stipulated by economy reasoning for every 
iteration as well as by a. minimal number of iterations. Let D = D* > 0 
be an arbitrary operator and the operator A = A* > 0 from the equation 
Au — f be a sum of mutually adjoint operators Aj and A 2 '. 


A\ = A 2 


(75) 


A = A*>0, A = A 1 +A 2 , 
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by means of which the factorized operator B is selected by the rule 

(76) B = (D + loA 1 )D~ 1 (D + loA 2 ), 

where ui > 0 is the iteration parameter. The operator B so defined is 
.self-adjoint and positive. Once supplemented with the conditions 

(77) A>6D or (Ax, x) > 6 (Dx, x ), 6 > 0 , 

(78) AiD~ 1 A 2 <~A or (D~ x A 2 x, A 2 x) < ^ (Ax, x ), A>0, 

which are valid for all x 6 H, Theorem 2 and formulas (27)—(30) continue 
to hold with the operator A standing in place of the operator R, so there 
is no need to rewrite them once again in a common setting. 

Of special interest is the well-founded choice of the operator D under 
the agreement that the appropriate matrix D is diagonal: 

(79) Dy = d(x) y, cl(x) > 0 . 

Because of this form, the member d(x) is so chosen as to maximize the 
ratio rj = 6/A in the modified alternative-triangular method (MATM) with 
reasonable efficiency. 

Adopting those ideas, some progress has been achieved by means of 
MATM in tackling the Dirichlet problem in an arbitrary complex domain 
G with the boundary T for an elliptic equation with variable coefficients: 



x = (x 1 ,x 2 )eG, u(x) = fi(x), iff, 


k a (x) > G > 0 , a = 1,2 . 

The usual assumptions are made here saying that the boundary T is smooth 
enough and the intersection of the domain G and a .straight line passing 
through any point x 6 G and in parallel to the axes Ox a , a = 1,2, consists 
of a unique interval. The latter should not confine generality. 

The design of a difference scheme for problem (80) is mostly based on 
a nonequidistant grid Q h (generally speaking, nonequidistant everywhere, 
not only near the boundary T). When drawing up the family of straight 
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lines x a = x^ a \ i a = 0, ±1, ±2,... , a = 1,2, the points x i = x^ 2 ^) 

constitute the basic pattern /?* in the plane (x lt x 2 ). Any such point x i 
belonging to G is called an inner node of the grid, the total collection of 
which is denoted by w ht that is, ui h — {xp £ 

The intersection of the domain G and any straight line passing through 
a point x 6 ui h and in parallel to the axis Ox a consists of the interval 
A a {x i ). The endpoints of this interval are called boundary nodes in the 
^-direction. A set of all boundary nodes in the x a -direction is designated 
by 7 a . The boundary j h of the grid ui h is just the union y h = j 1 U j 2 , 
making it possible to write clown u> h = ui h U 77 . 

Furthermore, let u> a (xp), j3 — 3 — a, a = 1,2, be a set of nodal 
points from the interval A a ; let tx+(x^) be a set containing ui a and the 
right endpoint of the interval A a ; let u> a (xp) be a set containing ui a (xp) 
and both endpoints of the interval A a . For an inner node x 6 ui a (xp), 
we denote by x ( +1 “) and adjacent nodes belonging to U> a {Xp). If 

x .(+i(») G: Ter i ib may happen that this node does not coincide with the node 
x (‘o,+i) Q f gj.jj p anc p The accepted view is connected with steps 
h±(x) of the grid as possible spacings between the nodal points x E ui h and 
the grid nodes x( ±la ) E u) h . 

What is more, at all inner nodes of the grid io h the mean steps are 
taken to be 


h a (x a ) = 0.5(x^+ 1 )-(^- 1 )). 

When the pattern of interest, happens to be nonuniform in either of the 
directions x a , that is, 


r (i a ) — h — D +1 +2 

the mean steps h a = h a become constant and at a near-boundary zone 
differ from h a . 


if h t < h a > then a. ,(+1 " ) 6 7 h , 


^(+^Or) -M ^(^a + 1) 

a / 10 cx 


(i a + 1 )h a 


With these ingredients, a reasonable difference scheme is 


( 81 ) 


A y- - f{x) , x E u h , 


y(x) = fi.(x ), x E 7/j , 
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where 


A = Ai + A 2 , 


T ( \ 1 ( + y (+lo,) - y 

A «y=(a 0 y*J f( . = ^^—- 

l/ (±lo) = J/(x- (±u ^) , a+ = a a (x {+1 ^) 


y-y { u) 
h~ 


ys a = (y-y ( la> ) 


y* a = {y {+la) -y) 


y& a = r- (y (+la) -y) ■ 

n c 

Here the coefficients a. Q and <p(x) are .so chosen as to provide on a uniform 
grid a local approximation of order 2. By analogy with Chapter 4, Section 
3 it is plain to justify the uniform convergence of scheme (81) with the rate 
0(\h\ 2 ). 

We proceed to more a detailed exploration of MATM for solving the 
system (81) of difference equations just established. For this, the sum 
A y = Ai y + A'j y involves the members 


(82) 


A w = 


h n V+ 2 b 


h+ 



2 _|_ 

(83) A 2y = Eljr y ^ 

0=1 a 

governing what can happen: y £ 
e lh . 


i+ 


l 


2?L \h+ h~ 


(K_ _ fC 


— y if ah 1 «) 6 j h and y Xa 


1 

h a 


y if 


Other ideas are connected with operators A\ and A 2 such that A a y = 
0 0 

—A a y, a = 1,2, for any y £ Q = H, where 0 is the set of all grid functions 

vanishing on the boundary j h . By the same token, A = A\ + A 2 = —A. 

0 

Under the inner product structure in the space H = Q 


(y,v)= J2 y(x)v(x)h 1 h 2 

.v £ cd/i 

the operators A\ and A 2 are mutually adjoint to each other: (Aiu,v) = 
(y, A 2 v). Because of this fact, the operator A = A\ + A 2 is self-adjoint. 



The alternative-triangular method 


705 


Cumbersome calculations for a proper choice of c/(x) will be excluded 
from further consideration. It seems worthwhile giving only the final results 
for the later use 


(84) d(x) = ^2 


\n a h+ y /^ 2 h Q 


1 

h+ h~ 

a a 


/ + V’a ’ 


(85) <p a (x p ) = max v[ a) {x) 


1p a ( x s) = max v i a H x 




/? = 3 — a , a = 1,2 . 

The functions i>{°^(x) and vp^x), a = 1,2, are declared to be solutions of 
the relevant problems 


( 86 ) 


( a a — —p[ a \ x a C < 


= 0 p (tV) = -^L_ 

1 h+ ’ 


t O) 

K '<4 


(87) 


v<- a > | = 0 . 

2 


P 9 i ti-Q, G y 


/4 } = 


1 I at a. 


2ft,, 


a _ a 

h+ h~ 

a a 


These will be given special investigation by means of the elimination method 
with 0(1) operations required at every grid node. With the intervention 
of four new functions i>[°^(x), v[ a \x) it is not difficult to develop the grid 
functions <p a ( x p) and i> a (xp) of one variable and then specify d{x) by for¬ 
mula (84). Under such a choice we obtain 


(88) 5=1, A = 4 max 

a — 1,2 


^{\f^p+^ x py 


leaving us with the iteration parameters ut 0 and {r t } and the iteration 
scheme 


fc + l k 

(D + ijA l )D- 1 (D + LjA 2 )^ y ^ ~ V + Ay = y>, k 

T k +1 


0 , 1 , 
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For determination of y we must solve the equation 
(D + ui j4j) D 1 (D + u> A 2 ) y = F 

with the right part p = B y +r k+1 (A v +<p) (v = y on u h and v = yon j h ). 
As usual, this amounts to successive solution of the following equations: 


(D + ujA^y - p , y\ ih = 0, 

(D + ui A 2 ) k y 1 = Dy= d(x)y, E l 7)i = 0 . 

I 11 this regard, the more detailed forms of the members may be useful in 
subsequent constructions: 


(89) 


where 



E 


^ lor) 


k 

+ F 


i+i 

y 


1 

A 7 


E 


uja+ fc+i ( +1 
-— y 

h « h t 


+ dy , 


(90) 



The same procedure is workable here as was done in Section 5 of the present 
chapter. 

9. The Dirichlet problem for Poisson’s equation in an arbitrary complex do¬ 
main. The algorithm of MATM is demonstrated by appeal to the Dirichlet 
problem associated with Poisson’s equation 

Q 2 U d 2 u 

a U = dx 2 + dx 2 = ’ x 6 G ’ u = d( x ), zer. 

In working on a square pattern 


lo h — — {i-yh-} 12 ^ 1 ) G i i a 0, =bl, . . . , tv 1,2J, 

x (i a +i ] = x {iA + hj ia = 0 ,±1,... , a = 1,2, 
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where h a = h and differ from h only at the near-boundary nodes, the 
intention is to use scheme (81) with the members a a (x) = 1 and h a = h, 
so that 

A y = y SlXl + y S2X2 = ~<P , x 6 co h , y\ ih = y . 

In an attempt to adapt here MATM, the functions Uj(x - ) and v 2 {x) are 
declared to be solutions of one and the same equation 


K v = v £ . aXa = -p(x ), x a Eu a (x p ), ?)|^=0, ft = 3—a , a =1,2, 
but with different right-hand sides 


Pi( x ) 


1 

h h+ 

cy 


p 2 (x) = 


1 

2 Ti 


1 

h+ 

a 



Denote by x a = l a (xp) and x a = L a (xp) the endpoints of an interval 
A a and by h~ and /i+ irregular steps at the left and the right ends of this 
interval; in so doing 


A a v 


1 — v v — ^ 

h \ h h~ 

a 

< 1 /v(+ 1 “) — v v — v(~ la ) 

h \ h h 

1 — V V — 

, h V h+ h 

v a 


x a — + h a , 

^a + h a < x a < L a — h~X , 
X a = L a — ■ 


The functions and vf‘\x) can be found in explicit form, while the 

functions <p a (xp) and ip a (x'p) are expressed by 


, \ 1 (La{Xp) l a {Xp)\ 2 


VaOd 


8 = 3 — a , cv = 1,2, 


giving A due to (88) and evaluating the number of the iterations: 
(91) n>n 0 (e), n 0 (e) = 

where l 0 is the diameter of the domain G of interest. 


In (2/e) 
3.4 v/h/I 
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This provides enough reason to conclude that in the case of any com¬ 
plex domain the number of the iterations depends only on the main step h 
of the grid c o h regardless of near-boundary nodes. 

Applying (91) to the model problem in a square of sides l 0 yields 

„ (£) - In ( 2 Z £ ) 

° ( 3.54VW 

whence it follows that the number of the iterations in an arbitrary domain 
G is being increased in 3.54/3.4 = 1.04 times, that is, in 4% in comparison 
with those performed in a square, whose sides are equal to its diameter, 
thus causing one-two iterations in practical implementations for e = 10~ 4 
and h = 1/I00. 

Summarizing, the number of the iterations required during the course 
of MATM in an arbitrary complex domain is close to the number of the 
iterations performed for the same Dirichlet problem in a minimal rectangle 
containing the domain G and numerical realizations confirm this statement. 

10. On solving difference equations for problems with variable coefficients. 

In the preceding sections this trend of research was due to serious develop¬ 
ments of the Russian and western scientists. Specifically, the method for 
solving difference equations approximating an elliptic equation with vari¬ 
able coefficients in complex domains G of arbitrary shape and configuration 
is available in Section 8 with placing special emphasis on real advantages 
of MATM in the numerical solution of the difference Dirichlet problem for 
Poisson’s equation in Section 9. 

One of the most important issues is concerned with a smaller number 
of the iterations performed in the numerical solution of equations with 
variable coefficients. It was shown in Section 7 that the number of the 
iterations required during the course of ATM is proportional to \/c 1 /c 2 , 
where cq and c 2 are the smallest and the greatest values of coefficients, 
respectively. The operator R in question can be put in correspondence 
with the operator A with variable coefficients such that 

c 1 R < A < c 0 R. 

One way of covering this is connected with further intervention of the dif- 

0 0 

ference Laplace operator A : R-— A ■ A key role of R owes a debt to the 
structure of the factorized operator B ; 


B — (id -)- lo Ah) {E -)- lj R2) , Ri T R2 — R , Ai* — R2 ■ 
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But it may happen that the coefficients of the governing differential equa¬ 
tion are varying very fastly, but locally in a, small region so that the spectral 
bounds of the operator A change insignificantly. 

In the case where G is a rectangle, it is possible to adopt B = R with 

further reference to one of the direct methods available for determination 
k + 1 

of y , thus causing the ratio £ = c,/c 2 and the independence of the total 
number of the iterations upon h: 



Recall that in the modification of ATM (MATM, see for more detail Section 
8) there is no need for involving the operator R and so a proper choice of 
parameters {r n } will be independent of constants c 1 and c 2 both. Here the 
operator A arranges itself as a sum A = A\ + yR. 

By having recourse to problem (81) in a unit square we will illus¬ 
trate the performance of MATM in the sequel. In preparation for this, we 
introduce a square grid 

= i x i = (hh,i 7 h ), i a = 0,1,... , At, hN = 1 , a = 1,2} 

and write down on it the equations 

(<T + ( a 2 = -<p, x e ui h , y| 7h = 0. 

The coefficients a^.-c) and a 2 (x) are given by the formulas 
a 1 (x) = 1 + A' 0 [(»! - 0.5) 2 + (x 2 - 0.5) 2 ] , 
a 2 {x) = 1 + K 0 [0.5 - (x 1 - 0.5) 2 - [x 2 — 0.5) 2 ] , 

A'o = const > 0 . 


A proper choice of the right-hand side <p(x) is stipulated by the fact that 
y(x) = x 1 (1 — aq) x 2 (1 —x 2 ) is the exact solution of the problem concerned. 
Also, it will be sensible to introduce 


Cj = min a a (x) = 1 , c 2 = max a a (x) = 1 + 0.5 I\q 

x',0—1,2 x, o—l ,2 

and then take the operators R\ and with the values 

d _ y %i , 2 d y*i y*2 



710 


Methods for Solving Grid Equations 


Adopting those ideas, the framework of ATM (see Section 7) involves the 
operator B = (E + u> Ri) (E +u> R 2 ). By going through the matter chrono¬ 
logically we rely on A = A\ + A 2 with the members 


A ^y = E 


y 

: 2h 2 


My = -Y, 

orzz 1 


-y x . 



The operator D arose in Section 8, by means of which it is plain to form 
B = (D + lo A!) D^iD + lo A 2 ). 

No wishing to cover the computational procedures of MATM once 
again, we fill in the table on the basis of numerical experiments for £ = 10~ 4 . 


Table 6 


C 2/ C 1 

h= 1/32 

h=l/64 

h=1/128 


MATM 

ATM 

MATM 

ATM 

MATM 

ATM 

2 

20 

23 

28 

32 

39 

45 

8 

23 

46 

33 

64 

47 

90 

32 

25 

92 

37 

128 

53 

180 

128 

26 

184 

39 

256 

57 

360 

512 

26 

367 

39 

512 

59 

720 


From here it is easily seen that MATM offers more advantages not only in 
an arbitrary domain, but also in the case of variable coefficients, 


10.4 ITERATIVE ALTERNATING DIRECTION METHODS 

1, The alternating direction method for solving the difference Dirichlet 
problem in a rectangle. So far we have considered the Dirichlet problem 
for Poisson’s equation in a rectangle G = (0 < x a < l a , ce = 1,2): 

Au = Ai u + A 2 u = -f{x ), x<Eco h , u^=/r(x-), 

A a y = y$ aX . 0 , a = 1,2, 

= “h + l h - {%i = (i 1 h l ,i 2 h 2 ) 6 G} , 


( 1 ) 
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The numerical solution of problem (1) by means of iteration schemes can 
be done using the alternating direction scheme for the heat conduction 
equation du/dt — An + f(x), taking now for j = 0,1,... the form 

( 2 ) -- - [ ~ L =Aity +ll2 + A2ij 3 +f(x), 

r )+i 

x<Etj h , y j+1/ ' 2 \ lh = K x ), 

?; i + i _ ,b+i/2 

--^-= A! + A 2 yj + 1 + f{x ), 

r ;+i 

y J+1 \ lh = t-i(z), 

with any initial data y° = y{x, 0). As usual, j is the number of the iteration, 
(/i + i/2 fg the intermediate iteration, > 0 and > 0 are the iteration 
parameters which will be so chosen as to provide a minimal number of 
iterations. 

The transition from the ith iteration to the (j + l)th iteration can be 
done by the elimination method along the rows as well as along the columns 
for the following three-point equations: 

2/ J + 1/2 ~^+iAi2/ i+1/2 = F\ 

(along the rows) 

P ] = y j + A 2 ij + r^ + \ J , 
y j+1 - A 2 y j + 1 = F j+1 P 2 , 

(along the columns) 

F ;+l/2 = j^ + l/2 + t ( 2 + \ Aj yJ+F 2 + ^ f 

Thus, the users must perform 0{l/(h i h 7 )) arithmetic operations in calcu¬ 
lating one iteration or 0(1) arithmetic operations at every node of the grid 

^ h ■ 

By analogy with the nonstationary heat conduction equation the it¬ 
erative process (2) is referred to as the alternating direction method 
(ADM), the convergence of which can be established on account of the 
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homogeneous equations for the error z 3 + 1 = y 3 + 1 — u: 
z 3+1 ! 2 - z 3 


r (1) 

r ;+i 

z 3 + l - z 3 + 1 ! 2 


r (2) 

r ;+i 


= A lZ 3+1 / 2 + A 2 z 3 , 

x £ w 7i J 

=“• 

= Ai z 3 + 1/2 + A 2 z 3+1 

, x Ew h 

. --' + \ = 0 . 


Here we accept, on the same grounds as before, z 3+l l 2 = y 3 + i ^ 2 — u. 

In this view, it seems reasonable to turn to operator-difference schemes 

and then follow the usual practice: the operators A\y = —Ai y and A^y = 

0 

—A 2 y are introduced for any y from the space H = 12 of all grid functions 
defined on the grid ui h and vanishing on the boundary j h under the inner 
product structure 

(y, y ) - v( x ) v ( x ) h 1 h 2 

.v G ujfo 


Ni — 1 A^2 ~ 1 

— ^ > 'y , y(h hi X- 2 h 2 ) v(i l h 1; i 2 h 2 ) hji? . 
i 1 = 1 *2-1 

It is well known that the operators so defined possess some remarkable 
properties: 


A*=A a , 8 n E < A a < A a E , A > 0 


1 , 2 . 


, _ _ 4 _ . 2 ^0 

6 ° ~ h 2 Sm 2 L 


h 2 cos 2L 


a = 1,2 . 


What is more, the relation A 1 A 2 = A 2 A 1 takes places in various rectangles 
only. 

2. The general framework of ADM. The object of subsequent discussions 
is an operator equation 


(4) Aw,_/, A — Ai + A 2 , 

where A : H 1 —► H, H is a finite-dimensional Euclidean space with an inner 
product (y,v) and associated norm ||y|| = \J{y,y). 
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Also, we take for granted that 

(5) 1) a = a 1+ a 2 , A*=A lt a; = a 2 , 

(6) 2) S a E < A a < A a E , 6 a >0, a =1,2, 

3) the operators A\ and A 2 are commuting: A\ A 2 = A .2 ^4i , 

and develop the iterative alternating direction method with these members 
in just the same way as was done before for scheme (2): 

(V m Vj + i/2 + ^2 Vj = / , 

r ;+1 

Vj +1 ~ ^i + i/2 , , , _ , 

(2) ^ 711 Vj + 1/2 + ^2 y j + 1 - / , 

T i +1 

given y 0 6 H , j = 0, 1,2,. .. 

For the error z j + \ = Vj + i ~~ u > we must solve the homogeneous equations 
(E + Ai) z j + 1/2 = (E- A 2 ) ^ , 

(iS + ^'A 2 )^ +J = [E-r^Ajz^, 2 , 
z 0 = y 0 - u £ H , j = 0,1,2,.... 

Having completed the elimination of Zj +1 j 2 , we find that 

+ rf + \ A 2 ) z j + 1 = (E- A,) (E - t^\ A 2 ) Zj 

by observing that 


A + i 


S. 


i + i 


Si 


d+i 


eO) q( 2 ) 

°; +1 °j +1 


= (^+7 } (2) A 2 )- 1 (^-rf ) A 2 ), 
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since the operators Ai and A 2 are commuting. As a final result we get 

n 

(8) z n = T n z 0 , T n = Sj , 

3 = 1 

where T n is a self-adjoint operator (T* = T n ) as a product of commutative 
self-adjoint operators involved. 

From (8) the estimate || z n || < || T n || ■ || z 0 || immediately follows, in 
which the quantity \\T n || depends on the parameters r- ^ and Tp\ Roughly 
speaking, a proper choice of such parameters is stipulated by the minimum 
condition for the norm || T n || in connection with a minimal number of the 
necessary iterations. To be more specific, when making a substantiated 
choice, we have at our disposal two collections of parameters rj l \ 

. . . , and Tp, tP , . . . , r*- 2 ) with a. prescribed number n = n{e) that 
are known to us in advance: 


\ j , j 1 

3. A proper choice of iteration parameters by Jordan’s rule. First of all, 
observe that the spectra of the operators A 1 and A 2 are located, because 
of ( 6 ), on different segments S a < A (A a ) < A a with 6 1 yf S 2 and yf A 2 . 
One trick we have encountered is to replace A\ and A 2 by the newly formed 
operators A\ and A' 2 with coinciding bounds: 

E < A' a < E , a = 1,2 , i] > 0 . 


This can be done using the decompositions 

(9) A^iqE-rA^iA^-pE), A 2 = ( 9 E + r A' 2 )~ l {A' 2 + pE ), 


where the numbers r, q, p are free to be chosen in any convenient way and 
the new parameters cu*- 1 ) are taken to be 


( 10 ) 


uM = 


— rlhr 


,( 2 ) 


t-O) -)- r 
q + r (2 lp 


With these, we arrive at 


s^s^sp, 

^(E + J^A'.r^E-coP A[), 
§P 1 = (E + cuf 1 A! 2 )~\E - upA' 2 ). 
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The norm \\T n || can be expressed through the eigenvalues of the operators 
A\ and A' 2 such as 

^ , /3 k2 =\ g>(4>), k a = 1,2 ,... , N a , a =1,2. 

As far as the operators A[ and A' 2 are commuting, other operators Ai, 
A 2 , A and T n possess common systems of eigenfunctions. By utilizing this 
fact we denote by \ k (T n ) the eigenvalues of the operator T n and take into 
account that 

A(5'( 1 )) = (1 -u&a)/(\+uWa) , A^) = (1 - W 2) /?) 


with missing subscripts j and k. All this enables us to find that 


( 11 ) 


KTn) = n 

i = 1 


1 — uij^a l — [3 

1 + c J'p (3 


with 


0 < t] < a ki < 1 , 0 < rj < (3 k _ : < 1 , k a = 1, 2,. .. , N a , a = 1,2 . 

As known, the norm of the operator T n is equal to the greatest eigen¬ 
value max*, A k (T n ). Further replacements of a k and \3 k , t in (11) by contin¬ 
uous variables a and (3 lead to increased maximum of the right-hand side 
of (11); meaning 


( 12 ) 


||T n ||< max 
ae[v, 1] 


n 


n 


1 -d'V 

1 + ca ( 1 1 a l+wj 2) /? 


Also, we may accept u/ 1 ) = uj 1 - 2 ) and a = f3, since the arguments a and 
(3 run over one and the same segment [?j, 1] and their positions in formula 
(12) are certainly symmetric. The problem statement here is to find the 
parameters Uj,w 2 ,... ,cj u for which 


(13) 


min 


K-} 


n 


max 

«£[').!] 


n 


1 -“j a 

1 + u j a 


2 


A solution of such a problem is already known and so it remains only to 
write the final expressions for optimal parameters rj 1 '* and in question. 
Having stipulated the conditions a = (3 = r) for A(Ai) = S ly \(A 2 ) = S 2 
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and a = ft — 1 for A(j4i ) = Aj, A(A 2 ) = A 2 , the constants p } q , r, rj are 
found by the formulas 


(14) 


(15) 


1~* , = / (A 1 -g 1 )(A 2 -^) ' 

l+t y (Ai + <5 2 ) (A 2 + <5j) 

_ x - t _ (Ai - <Sj) A 2 
P ~ x + t ’ (A 2 + 5JA! ’ 

Ai - A 2 + (Ai + A 2 )p 1 -p 

2AjA 2 1 Aj 


with h > t and p > 0 . 

At the next stage, with reasonable accuracy £ > 0 and knowledge of 
the spectral bounds 6 a , A a of the operators A a simple algebra gives p, p, q, 
r by formulas (14)—(15). When providing a prescribed accuracy e > 0, that 
is, || y n — u || < £r 11 y 0 — u ||, it is necessary to perform n = n(e) iterations 
that can be most readily evaluated by the approximate formula 


(16) 

In the new notations 

1 


n(e) 


14 4 

— In - In - . 

7 T z € ?? 




2 j-l 

2 11 


, j = 1 , 2 ,... ,n. 


the quantities w.- are specified by the formulas 


(i + 2 0)(i + e a ) 


j = 1 , 2 ,... ,n. 


3 2 9 a ! 2 (1 + 6 l ~ a + 9 l+a ) ' 

In agreement with (10) the undetermined parameters become 
(l) _ g Uj + r ( 2) _ g Uj - r 

3 1 + id .■ p ’ 3 1 — IjJa p ’ 


making it possible to solve problem (7). 

It should be noted that for particular values iq = 62 = 6 and Aj = 
A 2 = A formulas (14)—(15) give x = (, p = r = 0, <7 = 1/A and £ = 
(1 — 77 )/(1 + 77 ), p = 8 / A. Via transforms (9)—(10), amounting for now to 
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Ai = AA\, A 2 = AA 2 , uji 1 ) = Art 1 - 1 and cui 2 ) = A t^ 2 \ we might have 
r (!) = r ( 2 ) = T under the condition cji 1 ) = c A 2 ' 1 . 

For the model problem (37) posed completely in Section 2 we obtain 

2 7T h 7 t 2 h 2 4 __ 16 1 1.6 

^ ® 2 4 ’ i] tt 2 h 2 h 2 ’ 

giving in combination with (16) 

1 27 4 

71 (f) ~ 0.2 In —— In - . 

h £ 

Thus, for example, we find that n{e) 6 for h = 1/10, n{e) ~ 9 for 
h = 1/50 and n(e) 11 for /i = 1/100 with reasonable accuracy e = 
2 e -10 ss 10“ 4 . 

4. ADM for the case of noncommutative operators. Of special interest is 
the equation of the form 

Au- (Ai + A 2 ) u = / 

with noncommutative operators Ai and A 2 still subject to conditions (5)- 
(6): 

A a = A* a >0, S a E<A a <A a E, S a > 0, a = 1,2. 

These properties have had a significant impact on modifications of 
iterative methods and provide the possibility of applications of the two- 
parameter iterative ADM: 

(17) (E + Ai ) y k+ i/ 2 — (E — Wj A 2 ) y k +uj , 

{E + lo 2 A 2 ) y k + l = (E - ui 2 A l ) 74+1/2 + u. 2 f , 

given y 0 6 H , k- 0,1,2,... , 

where a proper choice of parameters Uj and 1 o 2 will be substantiated a little 
later for some reason or another. 

Consistent with z k+l = y k+[ — u a.nd z k+l j 2 = J/t+ 1/2 — u 4S idea, 
of setting up the homogeneous equations for the error such as 

(18) (E + Uj Ay) z k+1 / 2 = (E — Uj A 2 ) z k , 

(E + lu 2 A 2 ) z k+l — {E — lo 2 Ai) z k + l j 2 , 

given z 0 E H , k = 0,1,2,.... 
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Having involved v k = (E + c o 2 An) z k with furter elimination of z k+i / 3 from 

(18) , we derive the equation 

(19) v k+1 =SiS 2 v k , v 0 eH, k = 0,1,2,..., 

whose transition operator S arranges itself as a product S = S[ S 2 with the 
multipliers 


51 =(E + lj 1 A 1 )- 1 (E-lj 0 A 1 ), 

( 20 ) 

5 2 — {E + ui 2 A2) 1 (E — u> 1 A2 ) . 

This is showing the gateway to subsequent considerations: since 

IK + iII<I|SiS 2 || • |k,||, 

it is necessary to evaluate the norm 11 S'i -ST 11 and find min w w , HAikH 
with the aid of the well-established relation. 

As further developments occur, we need an auxiliary lemma. 


Lemma Let an operator A : H 1 —► H be in line with the conditions 

( 21 ) A = A* > 0 , SE < A < AE , <5 > 0 . 

Then the norm ||5(w)|| of the operator S(ui) = (E+uiA)~ 1 (E—ljA) attains 
for ui = u> n = .. the minimal value 

VSA 

min || S(w) || = || S(ui 0 ) || = T~~m= , where V=~. 
w 1 + vm A 

For the most part, the proof is connected with further treatment of 
S(u>) as the transition operator of the two-layer scheme 

( 22 ) (E + LoA) lJk+ l~ Vk +Ay k = 0, * = 0, 1 . y 0 6 H , 

iijJ 

with the operator B ~ E -\-loA involved. This supports the view that 
Vk+1 = S(w)y fc , II Z/fe+i II < p\\ih II - 


where p = p(u>) = || S(u>) || needs to be minimized. 
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Along these lines, it is worth noting that we are still in the framework 
of the general stability theory outlined in Chapter 6 , Section 2 for difference 
schemes like ( 22 ) asserting that a necessary and sufficient condition for the 
estimate 11 H^, < p 1111 to be valid for any 0 < p < 1 and any operator 
D = D* > 0 commuting with A is 

^(E + mA)<A< ^(E+uiA). 

2ui 2i0 

This is acceptable if we agree to consider D = E or D = A. In this regard, 
it should be noted that the preceding is equivalent to the bilateral operator 
estimate 

— E < A < — E , where £ — -- and p = - - . 

LO £cU 1 + p 1 + £ 

Putting these together with ( 21 ) we conclude that 

f 1 1 

(23) — < S , — > A or £ w < — , so that £ 2 < i ], 

io £ io A 

it being understood that the minimum of p will be attainable in the case 
of the maximal value of £ in (23). This is certainly so with 

£ _ £ 1 A C_ ^ 


= S , — 

£tu 


£ = v/»7. 


whose use permits us to establish the chain of the relations 

_ £ _ Vv _ 1 


S S ^/SA 


and arrive at 


min p( w) = p(io 0 ) = 1 . 

w 1 + VT 

However, the same result can be obtained by a simple observation that 

. 1 1 — w A l 

P = II II = .max ——r , 
i5<A<A I 1 + w A I 

where A = A(A) is an eigenvalue of the operator A, Plain calculations show 
that 

r \ . | 1 - w A | 

mm p(u) — mm max --- 

uj uj t>< A< A I 1 “I - LO A I 


/ 1 — c o 8 cj A — 1 

=: mm max -- , —-- 

-A- < 4- V 1 + CJ <5 CJ A + 1 


= iK) = ! , ^ fol ‘ u; = cu 0 , 

1 + Vp 
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thereby completing the task of motivating the desired minimum. 

Via transforms (9)—(10) available for the operators Ai and A 2 and the 
parameters Uj and u> 2 we accept 

Ld + — V LO 2 ~\~ V 

- = id } - — LJ 

q - W,p q + ui 2 p 

making it possible to reduce the operators specified by ( 20 ) to 

S = 5i 5 2 , 


,Sj = (E + tjA'd-^E-LjA^, 

S 2 = (E + uA^-'iE-uA'z). 

Their members satisfy the relations 


p E < A' a < E, a = 1,2 , 77 > 0 . 


In the preceding reasoning the member p and the parameters p, q, r are 
given by formulas (14)—(15). With the inequality ||,5'|| < ||,Sj || • ||,?2 || in 
view, the lemma asserts that for lo = cj 0 = s/rj/S 


min || Si || = min || S 2 


1 +v^? 


and a solution of problem (18) obeys the a priori estimate 


(24) || (E + ui 2 A 2 ) z n || < p n || (E + lo, 2 A 2 ) z 0 || , p 


with Uj and c o 2 still subject to the relations 


1 + v^ : 


r + qco 0 qu 0 ~r yEj 

(25) cj, = --, id 7 — - -, = —— , 

■ J 1 1 + pw„’ 1 -PLU 0 ° <5 


In particular, p = S/A for Si = S 2 = S and Ai = A 2 = A. 

From (24) it follows that the condition p n < e of the termination of 
iterations is ensured if 


n > n^^e ), 


n^^e) = 


ln(l/e) 

2 (, 


where 


= M. 

1 + p ’ 
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In order to understand the nature of this a little better, we refer to a 
model problem posed in Section 2 all over again for which 



The main goal of subsequent considerations is the comparison between 
ADM of the type (17) with parameters (25) and the explicit method with 
optimal set of Chebyshev’s parameters 


Vk + l Vk 
T k + 1 


+ A y k — f , k — 0,1,.. 


arising in Section 2 and requiring no less than iterations: 


n > n( 0 \e 


r(°)(e) = ln(2/e) 


2 ^ 


£ = 7i/y 2 


In that case 7 j = 8 1 + 8 2 
Thus, we might have 


2 8 , 7 2 = Aj + A 2 = 2 A and £ = 8 /A = rj. 


1^(6 


ln(2/g) 

2^7 




(^) 


ln(l/£) 

4 ^ 


thereby justifying that n 1 - 0 ^) « 2if4(e). 

When solving the model problem concerned, the transition from the 
kth iteration to the (k + l)th iteration is performed either in 9 steps or in 
26 steps: 5 operations of addition and 4 operations of multiplication during 
the course of the explicit Chebyshev’s method and 12 operations of addition 
and 14 operations of multiplication in the case of ADM in connection with 
the double elimination (first, along the rows and then along the columns). 
This provides reason enough to conclude that in the case of noncommutative 
operators the first method is rather economical than the second one. Both 

methods require 0 (— In-) iterations in the process of solving the model 
h e 

problem under consideration. 
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5. Factorized iteration schemes and ADM. The main idea behind this ap¬ 
proach is connected with the equivalence between ADM from the preceding 
sections and the two-layer iteration scheme 

(26) B Vk+1 ~ Vk ■ + Ay k = f 

T 

with the factorized operator 

(27) B = (E + w 1 Ai)(E + w 2 A 2 ) 
and the iteration parameter 

(28) t = Uj + w 2 . 

To make sure of it, we rewrite (17) as 

(29) Bi y k+ i/ 2 = C -2 y k + w, / , B 2 y k+i = C k y k+l / 2 + w 2 / j 

where B 1 = E + u> 1 Ai, B 2 — E + u> 2 A 2 , C i = E—lu 2 Ai and C 2 = E — ( J j 1 A 2 . 
The elimination of the iteration y k+ i/ 2 can be done by successively applying 
the operator C\ to the first equation and the operator B 2 to the second one. 
Combination of the resulting equations with further reference to the useful 
relations B\E\ — C\B k , c u T uj^B\ — uj ^E — lo 2 Ai^ T lo 2 {^E -f cUjAr) — 
(w, + oj 2 )E gives 

(30) B\B 2 y k+ i = C\C 2 y k + (w, + w 2 ) /. 

It seems worthwhile to reduce equation (30) to the canonical form (26) by 
observing that B\B 2 — C k C 2 = (cUj +cu 2 )(Ai + A 2 ). The arguments in 
reverse order are obvious. 

Let us stress here that the applications of the above framework to 
noncommutative operators Ai and A 2 could result in wrong reasoning in 
light of the property that operator (27) is non-self-adjoint and scheme (26) 
does not fall within the category of two-layer iteration schemes lying in the 
fundamentals of the general theory. 

Before going further in more detail on this point, it is worth mention¬ 
ing that the factorized operator (27) is self-adjoint and positive; B = B* > 
0. To decide for yourself whether the obtained results are acceptable for 
commutative operators A\ and A 2 and conditions (5)-(6), the first step is 
to discover from (30) the structure of the transition operator of scheme (26) 
such as 

S = SjS 2 , Sa = B~ l C a , a ~ 1,2. 
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We learn from Section 4 the values of parameters u, and uj 2 for which 
the minimum p of the norm || S(u>) || is attained: 


min || 5 \\ = p , 

u>y , u>2 


p = 


i + -/n 


= i-e f = h/l 

! + £’ * 1 + jy’ 


where p, u, and ui 2 are given by formulas (14), (15) and (25). Knowing p, 

0 0 

u>j and w 2 , it is simple to compute the constants of equivalence 7 1 and 7 , 
for the operators B and A such that 


(31) 


0 0 
7 iB < A <7 


which will be needed in subsequent discussions of the operator B from a 
viewpoint of the possible general theory. 

A necessary and sufficient condition for the p-stabity of scheme (26) 


is 


1 ~P 


T 


B < A < 


1 +P 


B 


with assigned values of p and r = u, + ui 2 . The outcome of this is 


(32) 


I-P 2£ 

uq + lu 2 (1 +£)(uq +w 2 ) 

1 + P _ 2 

W l+ W 2 (l+0( W ld" W 2) 


A keystone in the design of an operator of the type (27) is the possible 
structure of an auxiliary operator R = R* > 0 being a sum of two operators 
Ri and ith such that 


R — R\ + R 2 , R\ R 2 — i? 2 R\ , 

R a — R* a , S a E < R a < A a E , a = 1, 2 , 
by means of which the factorized operator in question reveals to be 

(33) B = (E+wR l )(E + wR 2 ). 

0 0 

This serves to motivate instead of (31) the relations 7 1 B < R < 7 2 B with 
0 ° 

constants 7 1 and 7 2 arising from (32). 
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When the operator R happens to be a regularizer for the operator A, 
that is, c 1 R < A < c 2 R, the constants of equivalence for the operators A 
and B such that j 1 B < A < j 2 B become 

7i = G 7 1 , 72 = c 2 7 2 . 

The intention is to use such a factorized operator in the explicit 
method with optimal set of Chebysliev’s parameters: 


B 


Vk +1 - Vk 
T k+i 


+ Ay k — f , k — l,2,...,n, y 0 £ f , 


which requires no less than n 0 (s) iterations: 


n>n 0 (e), n 0 (e) 


In (2/e) 

2 


2 y/v A 

1 + t] c 2 ' 


In complete agreement with (22), y is expressed through the parameters <5j, 
<5,, Aj and A 2 of the operators R\ and R 2 involved. 

It is worth noting here that the same estimate for , n 0 (e) was established 
before for ATM with optimal set of Chebyshev’s parameters, but other 
formulas were used to specify rj in terms of 6 a and A„. If R = —A, where 
A is the difference Laplace operator, and the Dirichlet problem is posed on 
a square grid in a unit square, then 


, , 7T h 

i] = 6 /A = tg 2 — 

for both cases: ATM and the factorized scheme (26)—(28) relating to ADM. 
Just for this reason these methods require the same number of iterations. As 
a matter of experience, ATM is more economical and preferable, since one 
iteration necessitates performing a smaller number of arithmetic operations. 
Some consensus of opinion here is to accept B — R and then find y k + i from 
the equation 


Ry k +1 = Fk , Fk = Ry k - r k+l (A y k - /), 

by one of the available direct methods, say by the decomposition method 
or Fourier fast transform method. 

Summarizing, we are somewhat uncertain in which situations scheme 
(26)—(28) would be more better than, for example, ATM. 
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Remark 1 From such reasoning it seems clear that ADM with variable 
parameters is equivalent to the two-layer scheme (26) with iteration param¬ 
eter t = r k = r k ^ + rj , 2 - 1 and factorized operator 

Bk ^{E + T^A l ){E + T^A 2 ). 

We will not pursue analysis of this: the ideas needed to do so have been 
covered. 

Remark 2 If A is a sum of p > 2 pairwise commutative operators such 
that 


A= A a , A* a = A a > 0 , 8 a E < A a < A a E , S a > 0 , 

a = l,2,...,p, A a Ap = ApA a , a, f3 = 1 , 2 ,... ,p , 

direct applications of ADM described by (17) is impossible in principle, 
so there is a real need for constructing scheme (26) with the factorized 
operator 

B k = Y[(E + T^A Q ), r ; (Q °> 0. 

a = l 

In this regard, we are unaware of any exact solution to minimax problem 
and the so-called cyclic set of the ensuing parameters may be of help in 
achieving the final aims. 

The main idea behind this approach is connected with the equation 
related to a new iteration 


II( £ + 


E'A a ) 


F k , 


which reduces to successive solution of p equations 
(E + r^Ai) yW = F k , (E + r[ a) A a ) = y^~ l) 


a = 2,... ,p, 


with j / k+1 — j/T-* incorporated. 

The difference Dirichlet problem for Poisson’s equation in a p-dimen- 
sional unit cube such as 


E a y = y Sa<Ca , 


A a y = -A a y 
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helps clarify what is done. As a matter of fact, searching for amounts 
to successive elimination along the directions x 1) x 2] . . . px p relating to al¬ 
gorithms of the ADM-type. The availability of the cyclic set of parame¬ 
ters gives us hopes to achieve a prescribed accuracy e by making n 0 (e) = 
0(ln(l//i) In (1/e)) iterations, where h — /q = h 2 = ■ • • = h p is the grid 
step. On the other hand, it is no difficult to achieve what we suggest by 
means of ATM with the operators 

p : P : 

Ri y = T,r ’ R i yz= -J2 y ■ 

Qr = l a a^l a 

This applies equally well to the problem posed above and requires no less 
than n : (e) iterations, where 


, , In (2/s) / 1 2 

• (£)! *«wr o ei ln F 


meaning that the asymptotic, behavior of ATM becomes worse in compar¬ 
ison with ADM. However, when p = 3 and h > 1/60, that is, the total 
number of the grid nodes < 2.16 ■ 10 5 , a smaller number of iterations is 
performed during the course of ATM in contrast to ADM with the cyclic 
set of parameters. With regard to the work and storage required, ATM 
being rather economical (in 2-2.5 times) offers more advantages than ADM 
on a.ny admissible grid no matter how it is chosen. 

6. ADM for noil-self-adjoint operators. The equation we must solve is of 
the form 

A u = (Aj + A 2 ) u = / , 

where Ai and A 2 are non-self-adjoint positive definite operators subject to 
the conditions 


(34) 


A o, > . 


Z_i rt 


6 a > 0 , A a > 0 , 


1,2 


As can readily be observed, the second condition is equivalent to the in¬ 
equality 


(35) 


\\A a y || 2 < A a (A a y,y). 


Indeed, by merely setting x — A a y, we are led to 


0 < (A a Uq x 



(x , x ) 


y,A a y) 


— (A a y,A a y). 

L\q, 
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In trying to solve the equation Au = / the iterative ADM with itera¬ 
tion parameter w is good enough for our purposes: 


(E + wAi)y k+ 1 j 2 — (A — wA 2 )y k + w / , 

(36) 

(E + loA 2 ) IJh + i = (E — wAi) yk + 1/2 + w .f- 

By exactly the same reasoning as in Section 4 with regard to the error 
z k+ 1 = 24+1 - « we deduce for n fc+1 = (E + ljA 2 ) z k + l that 


v k + i=S 1 S 2 v k , S a = (E + wA a ) l (E-LoA a ), a =1,2, 

IK + ill<l|S'iS 2 || ■ || v k || <|| Sf || ■ || S 2 1| • |K||. 

We are going to show that under conditions (34) the following estimates 
hold true: 


(37) ||S a || 2 < 


2 6„u> 


1 — K n 


1 + x ’ “ 1 4- w 2 <5 A c 


a = 1,2. 


Indeed, from the obvious identities 

|| (E - uiA a ) x || 2 = || (E + u>A a ) x || 2 - 4lo (A a x,x), 

|| (if + ujA a ) x || 2 = || x ||" + <+ 2 || A a x || 2 + 2 ui (A a x, x ), 
which are put together with inequalities (34)—(35), it follows that 
|| (E + Uj4 0 ) x || 2 < (l/h„ + u)"A„ + 2 u>) (A a x, x ), 


(A q x, x) > 


1 + w 2 <5 n A. a + 2 ui 8 C 


II (E + +4 a ) x || 2 , 


\\{E~uA a )x\\ 2 < i—^ \\(E + wA a )x\\ 2 , 

1 + H a 

By inserting here x — (E 4 -ujA a )~ [ we find that 


ll^2/|| 2 < 


1 - 
1 4- 


2 
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as required. By virtue of (37) it is plain to establish the relations 

II .S'. S 2 It < II Si II II s 2 II’ < = fH ■ 

Here the parameter w is so chosen as to satisfy the minimum condition for 
the function F(ui) by discovering that the functions F\ (w) = (1 —x x ) (l+x x ) 
and F 2 (lo) = (1 — x 2 ) (1 + x 2 ) attain the minimal values, respectively, for 
ui = 1/ sj 6 1 Ai and ui = These points are are identical when 

<5 x Ai = & 2 A 2 . In that case for to = l/\/o x Ai = 1/ sJb^K?, the inequality 


(38) 


I | 5 i 5 2 || 2 


<PA 


2 1 \fth 1 \Ah 

P = Ti—F= ' = Ti—F= ’ 
1 + y/ih 1 + x/% 


Va = 



a — 1,2, 


holds and the error z n = y n — u admits the estimate 


(39) || (E + wA 2 ) z n || < p n || ( E + wA 2 ) z 0 || . 

If <5 x Ai yf 6 2 A 2 , then ui — l/-v/5A, where 6 = min (<5 X , <5 2 ) and A = 
max(Ai, A 2 ). 

In comparison with the case of self-adjoint operators the number of the 
iterations is being increased in two times. This is clearly seen, for example, 
from (38) by setting S 1 = S 2 = S and A x = A 2 = A: 


P - 


i-Vv 

1 + V5T 


It should be compared with 


P = 


1 zaM 2 

1 + vV 


emerging from estimate (39) with regard to self-adjoint operators Ai and 
A 2 - One needs to exercise good judgement in deciding which to consider. 
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10.5 OTHER ITERATIVE METHODS 

1. Three-layer iteration schemes. So far we have considered two-layer 
iteration schemes available for solving operator equations of the form Au = 
/ with a self-adjoint operator A under the assumption that the spectral 
bounds 7 X and j 2 for the operator A are known in advance either in a space 
H or in a space Hg, where B = B* > 0 is some stabilizator. Other iterative 
methods find a wide range of applications in some or other aspects. 

An excellent start, in this direction is to describe three-layer (two-step) 
iteration schemes in the general setting due to which it is required to solve 
the equation 

(1) Au = f , A : H r-s- H , 

with a self-adjoint positive definite operator A, whose spectral bounds are 
already known: 

(2) A = A*, 7i E < A < j 2 E , ■y 1 > 0. 

The links between three iterations y k __ lt y k and y k+i are provided by 
three-layer iteration schemes, by means of which y k+1 can be expressed 
through the values y k _i and y k . The standard form of explicit schemes is 


(3) 14 + i - (1 + a ) Sy k — ory k _ l + (1 + a) r 0 /, fc— 1,2,..., 

Vi = S y 0 + r 0 / , given y 0 e H , 


where ,S = E — r 0 A is the transition operator for the two-layer simple 
iteration scheme with the optimal parameter r 0 


(4) 


2 


7i + 7 2 


2 1-v^ e 7i 

Pl = TT^' 


The two-layer simple iteration scheme permits us to find the first iteration 

Vi¬ 
la an attempt to create scheme (3), equation (1) should be represented 
in the so-called “preliminary” form 


u = u — tAu + rf = S(t) it + rf , S(t) = E — tA , 
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and the parameter r should be so chosen as to minimize the norm ||S'||. We 
now know from Section 2 that this aim can be achieved by setting r = r 0 , 
so that the preceding becomes 

(5) u = S(t : )u + t 0 f , 

allowing alternative forms of writing: 

(1 + a) u = (1 + a) S u + (1 + a) r 0 f , 


u = (1 + a) S u — a u + (1 + a) T : f . 

Having replaced (l + a)5u by (1 + 0)5?/,;. and au by ay k _ l) we try to adapt 
the explicit scheme, the parameter a of which needs to be selected by the 
approved rule in a minimal number of iterations. Unfortunately, more a 
detailed exploration on this point and the convergence of scheme (3) are 
not available in the present book. A final result can be obtained through 
such a.n analysis by utilizing the fact that the residual r k = A y k — f satisfies 
the homogeneous equations 


( 6 ) 


r k+1 = (l + a)Sr k -ar k _ 1 , k = 1,2,..., 
r i = Sr 0 , r : = Ay : - / £ H , 


no matter how the initial value ? j 0 is chosen. 


In a revised statement of the problem for a = pf the estimate 


( 7 ) 

is valid with 

( 8 ) 

assuring 


\ A Vn~ /II < <in \\ Al Jo - f 




In - + In fl + 1-- n) 

e V l + />2 } 


n > 


In 


Pi 


This is certainly so with 


n > 


In - + In 

£ 


1 + 


2yf”\ 
l+£ ' 


2\/e 


( 9 ) 
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2 P? 


valid for 


Comparison of (8) with the resulting expression for q n 

1 "h P\ 

Chebyshev’s scheme, shows that both schemes are of the same asymptotic 
order as £ ^ 0: 

n = n(e) = of-^= In -V 
Vt e ' 


Here n is, as usual, the number of iterations. But in practical implemen¬ 
tations Chebyshev’s scheme with known values ■y 1 and q 2 is preferable, 
because the extra iterations and storage are necessary for later use of the 
three-layer scheme concerned. What is more, the second scheme depends 
more significantly on the errors in specifying -y, and q 2 than the first one. 


Remark The passage from explicit three-layer schemes to implicit ones 
can be accomplished by the replacements of A by B~ l A and / by B -1 /, 
so that 


24 + i = (l + a)(E~r 0 B 1 A)y k - ay k _ L + (l + a) t 0 B L f 


or 

(10) By k+1 = (1 + a)(B - t : A) y k - aBy k _ 1 + (1 + a) r 0 / , 

By, = B y : - t : Ay : + t : f ,k= 1,2,... , given y 0 E H . 

Observe that equation (10) emerged from the identity 

Bu — (1 + cr) (Bu — t 0 A u) — aBu + (1 + a) r 0 / 

with further indication of iteration number in the appropriate positions, if 
any. formulas (4) for r 0 and a are still valid with known spectral bounds 
?i and q 2 

(11) 7i5<d<7 2 S, 7j > 0, B = B*> 0, 

for the operator A acting in a certain space Hg (not in the entire space 
H), making it possible to establish for a solution of problem (10) instead 
of (7) the estimate 

(12) \\Ay„ - fWg-, < q n \\Ay 0 - /l^-, 

with q n still subject to (8). This is acceptable if operator (76) is involved 
in the framework of ATM in Section 3. 
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2. The minimal residual method. Until now the bounds ■y 1 and -y 2 of the 
operator A were known before giving special investigations. But it may 
happen that these constants are either too rough or, generally speaking, 
indeterminate in advance. In mastering the difficulties involved, variational 
iterative methods such as the method of conjugate gradient, the minimal 
residual method and the method of steepest descent can be employed in 
the further elaboration on this subject. 

We confine ourselves here to the minimal residual method and the 
method of steepest descent relating to two-layer schemes. As usual, the 
explicit scheme is considered first: 

(13) Vk+i ~Vk +Ayk = f> fc = 0)1)2) ... , given y : eH, 

T k -f 1 
or 

(O') y k+1 = y k - T k+1 r k , r k = Ay k - / , 

where r k is the residual. 

The only difference between the methods we have mentioned above 
lies in the selection rules for the parameter T k+1 . In the minimal residual 
method the choice 

( 14 ) T k+i = |j A Ar k \\i ’ Whel ' e r * = Ayk ~f’ 

is stipulated by the minimum condition for the norm || r k+l || of the residual. 
In this context, several questions are yet to be answered. The equation for 
the residual 

(15) r JE±LZll + Ar k = 0, * = 0,1,2,... , 

T k +1 

implies that 

(16) || r k+l || 2 = || r k || 2 - 2 r k+1 (A r k ,r k ) + r 2 +1 || A r k || 2 . 

The right-hand side of relation (16) is the polynomial of degree 

2 with respect to the parameter r i+1 . Equating the derivatives /^(Ufe+i) 
to zero reveals T k+l in complete agreement with (14). Because the second 
derivative for that value of the parameter T k+1 is positive, the quantity 
|| r k+1 || of interest turns out to be minimal. 
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Adopting those ideas to the case of a non-self-adjoint operator A, we 
derive from the foregoing the a priori estimate 

(17) || r k+l || < p 0 || r k || , meaning || A y„ - f || < p” || .4 y 0 - f || , 

where p 0 = (1 — £)/(l + £), £ = 7 i/t 2 and , 7 , are the accurate bounds 
of the operator A ~ A* > 0. 

Indeed, for the value T k+1 assigned by (14) the right-hand side of (16) 
is minimal for fixed r k £ H. Due to this property it is being increased for 
all other values and, in particular, for r = r 0 . The meaning of this is that 
we should have 

IK+ill 2 < \\ r k\\ 2 ~ 2 T o(Ar k ,r k ) + t 2 \\ Ar k \\ 2 

< IK - T 0 Ar h || 2 < |K- r 0 A|| 2 • ||r fc l| 2 , 

II r k +1 II < IK - t 0 a || • 11^ ||. 

On the other hand, we learn from Section 2 that |K — r (Kll = Po f 01 ' 
r () = 2 /( 7 j + 7 2 ), thereby justifying estimate (17) and the convergence of 
the minimal residual method with the same rate as occurred before for the 
simple iteration method with the exact values ■y 1 and p 2 . 

During the course of MRM the same procedures (13') and (14) are 
workable with increased volume of calculations in connection with formula 
(14) for T k+ i as compared with the simple iteration method. 

The implicit minimal residual method can be designed in line 
with established practice: 

(18) y k+L = y k - r k+L w k , w k = B~ l (Ay k - /), 

which is referred to as the minimal correction method. In that case 
instead of the governing equation Au = / we are dealing with 

(19) Cv = <p, v = B 1 /2 u, C = B- 1 /2 AB- 1/2 , <p = B~ 1/2 f. 
Applying here the explicit, minimal residual method yields 

x k +1 = x k ~ T k+i{C X k-A), 


T k +1 - 


KK K) 
KKKK) ’ 


where 


h =C x k-A- 
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The forthcoming substitutions x k = B 1 / 2 y k , C — B l ! 2 AB l ! 2 and < p = 
B~ l l 2 f allow us to modify these into 

h = B- l ! 2 {Ay k ~f) = B~ i / 2 r k , 

(Cr k ,r k ) = (B~ 1 / 2 AB~ 1 r k ,B- 1 / 2 r k ) = (Aw k ,w k ), 

(C r k , Cr k ) = (B- l l 2 Aw k ,B~ l l 2 Aw k ) = ( B~ l Aw k ,Aw k ) , 


leading to equation (18) with the correcting term w k and parameter T k+l 
such that 


( 20 ) 


Wk = B lr k, 


_ (Aw k ,w k ) 
Tk+1 (B~ l Aw k , A w k ) 


Instead of (17) we eventually get one more useful estimate 


(21) Uy n -f II*-. <P^\\Ay 0 -f\\ B - 1 . 

3. The method of steepest descent. The explicit method of steepest descent 
is given by the formulas 


Vk +1 = Vk - T k +1 (Ay k - /), k = 0,1,2,..., given y : £ H , 
where 

(22) T k+\ = 7?’ rk \ , r k — Ay k — f, At = 0, 1, 2, , 

( Ar k ,r k ) 

arising from the minimum condition for the norm of the error z k = y k — u 
in the space Ha, meaning 

,™n \\ z k+i IL ■ IML = \/(Az,z) ■ 

i T k+A 

The error z k — y k — u satisfies the equation 


z k+i = z k ~ T k+1 Az k . 

By interchanging the variables v k = A l ! 2 z k we are led to 
(23) v k +i = v k -T k+l Av k . 
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Having squared their norms, we find that 

(24) || Vfc+i l| 2 = II v k l| 2 ~ 2 T k+ 1 (v k , A v k ) + r k+1 || A v k || 2 , 


giving 

(25) 


r A: + l 


(Av k ,v k ) 

II KIP 


under the above condition min || v k+ i 

i T k+ 1) 

section serve to motivate the estimate 


The arguments of the preceding 


(26) IK II < Po IK II • 

Thus, it remains to return to z k = A~ l ! 2 v k by observing furthermore that 


Az k = A (Vk -u) = Ay k - f = r k , 

( Av k> v k) = II K IP = || f*|| 2 , 

II Av k II 2 = i Ar k, r k) ■ 

All this enables us to transform formula (25) into formula (22) for later use. 
Moreover, from inequality (26) it follows that 

(27) \\y n - u \\ A < p n 0 \\y 0 - u \\ A , 

since 

IK II 2 = K,V„) = ( Az n, Az J = K 111 ■ 

No doubt, several conclusions can be drawn from such reasoning. First, the 
method being employed above converges in the space Ha with the same rate 
as the simple iteration method although it occurs in one of the subordinate 
norms. Second, the minimal residual method converges in the space Ha?, 
that is, in a more stronger norm. 

By analogy with Section 2 the implicit method of steepest descent is 
described by 


(28) B Vk+l Vk +Ay k =f, k = 0,1,2,..., given y 0 e H , 

T k +1 
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with parameters 


(29) 


T k +1 


( r k, w k) 

(Aw k , w k ) ’ 


B- 


1 k > 


= Ay k - f . 


Estimate (29) is still valid in that case under the following conditions: 


7 i B < A < 7 , B , 7 j > 0 , B - B r > 0 . 


4. On solving equations with non-self-adjoint operators. In dealing with 
an equation 

Au = f , A: H H , 

where A is a positive definite non-self-adjoint linear operator, the intention 
is to use one of the stationary iterative methods associated with the two- 
layer scheme, the parameter of which is constant: 


(30) -— +Ay k =f , k = 0,1,2,..., given y 0 e H , 

T 

The homogeneous equation for the error z k — y k — u amounts to 

z k+1 = S z k , S=E-tA, k = 0,1,2,... , z 0 e H , 

permitting to establish the convergence rate of iterations. At first glance, 
|| z k+i || < || 5 || • || z k 11. As before, a proper choice of the parameter r is 
stipulated by the condition min T ||,S'(r) ||. 

In such a setting the assumptions are made on the lower bounds of 
the operators A and A -1 : 


A > y 1 E or (Ay, y) > || y || 2 , ^>0, 

(3i) 1 

A 1 > — E or || Ay || 2 < 7 , (Ay, y ), > 0 . 

72 

A simple observation that the second condition for the case where 
A = A* is equivalent to the condition A < j 2 E may be of help in further 
elaboration on this subject. Provided the condition 2 — tj 2 >0 holds, we 
are able to arrive at the chain of the relations 

II Sy || 2 = || y- t Ay\\ 2 = || y\\ 2 - 2 r (A y, y) + r 2 || At /|| 2 

< l|i /|| 2 - 2 t (A y, y) + r 2 7 , (A y, y) = \\y\\ 2 - r(2 - rj 2 )(Ay) 

< II2/II 2 - r ( 2 - r 7 2 bb II V II 2 = (1 - 2r 7l + r 2 7l 7 2 ) || j/|| 2 , 
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yielding 


||S || 2 < 1 — 2 r 7 j +r 2 7l72 . 


Having stipulated the minimum condition for the preceding trinomial, the 
parameter r is found to be r = 1 /p 2 , so that || ,S || 2 < (1 — 7 i/ 7 2 ) or, what 
amounts to the same, 


(32) II S'|| < n / 1 - £ for t = l / 7 2 , t. — I 1 H 2 ■ 


In an attempt to generalize the results obtained to the case of three 
parameters 7l , 7 ,, q 3 , the operator A arranges itself as a sum 

(33) A = A 0 + A l , A 0 = i(A + A*), Ai = | (A ~ A*). 

Here Ao is a symmetric operator and Al is a sketch-symmetric, operator, 
so that 


A* 0 = A 0 , Al =-Ai , (Aix, x) = -(x, A\x) = 0 , 

meaning (Ax, x) = (AqX, x). Let the the members of the operator A be in 
line with the conditions 


(34) 7lE<A q <j 2 E, || Ai || < 73 , 

where 7 2 > 7 i > 0 ail d 7 3 > 0 are known numbers. 

An alternative form of the equation z k+1 = (E — TA)z k for the error 

z k +1 = Vk+i ~ u is 

(35) z k+l = (E-t A q -t Ai)z k - (6 E - t A 0 ) z k + [(l - 6) E - t Al) z k , 

where the number 0 < 8 < 1 is free to be chosen in any convenient way. 
The main goal of further development is to minimize the norm 


||S|| = \\E-t(A 0 + Ai) || 

by observing that on account of the triangle inequality 


(36) 


C k + l 


< 


E 


• Ac 


z k II + II (! - 0) z k ~rAiz k 


To this end, the numbers r and 9 are so chosen as to satisfy the minimum 
condition that we have mentioned above. As far as ■y 1 E < Aq < j 2 E for a 
self-adjoint operator Aq, we might have 



2 

7i + 7 2 ’ 


(37) 


mm 


= Po for 


r 
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where 

Po = 7-j-f - (=*-, 

1 + ? 72 

so that r = t o 0. The second summand on the right-hand side of (36) will 
be the subject of special investigations. The outcome of this is 

II (1 - 0) y - tAi y\\ 2 = (1 - 0) 2 \\ij\\ 2 - 2r(l - 6) (Aiy, y) + r 2 || Ai y\\ 2 


= (i “ ^) 2 II y II 2 + 7-2 II v I 
< [a~^) 2 + r 2 7 3 2 ] • \\v ii 2 


= [( 1-^) 2 + -o 2 ^73 2 ] • H ^ l | 2 > 

which assures us of the validity of the following inequalities for r = t 0 6: 


ll^ + i II <11 5 II • Ik* II, l|S||</(0), 

(38) / _ 

f(6) = 0 Po + \/(l — 0) 2 + 0 2 a 2 , a 2 = r 2 7 2 . 

In order to find the minimum of the function f(0), we calculate and analyze 
its derivative 

1-0 - u 2 0 _ a -a 2 _l -0 

; ( ’~ P ° y/( 1 — 0) 2 -\- cl 2 0 2 - P ° Va 2 + a 2 ’ a ~ 0 


y/(l -0y + a z 0 z + V 

The equation /'(0) = 0 gives p 0 \Ja 2 + a 2 — a — a 2 . It may be viewed a.s a 
quadratic equation with respect to a: 


(1 - /r) a“ - 2 a a + a (a - p 0 ) = 0 


with the first root 


a + Po 


1 -Po 2 

We note in passing that the second root is unacceptable in connection with 
the possible negativity for some value of the parameters a and p Q , Also, it 
will be sensible to introduce the notation x = -y 3 / y/ 7l q 2 + j 2 , so that 


2 _ 2 2 _ 4 7l q 2 X 2 (1~P 0 )X 

<1 <2 0 7 3 ( 7i+72 ) 21 _ x 2 1 _„2 


« 2 = 1 -Po 

X 2 1 — X 2 
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When providing current manipulations with 

^ 2/1 _ „2 


1 - P 0 + a = 1 ~ P t 
we find that 


2 , „ 2 _ ! „2 , x l 1 -Po) _ 1 -P 0 


2 a 2 


1 - x 2 


1 — X 2 X 2 ’ 


_ a 2 (* + Po) _ x(x + Po) 


1 + a 


^(1-a 1- 

_ 1 + xPo 

1 -X 2 ’ 

1 1 - x 2 


1 + O' 1 + xp 0 

and, consequently, the expression for the function 


1 1 r^> -; Po + a ~ a ~ 

f( e ) = T-— Po + T-r~ V« 2 + ct 2 = 0 - 

1 + CV 1+0 (1 + CVjpQ 


Taking into account that 


p Q T o ~ <+ ~ ( 1 T o) — ( 1 — P Q T a ) — 1 + o — 

_ 1 + xp 0 1 - P 2 o Po + H 
,2 - Po 


1 - X 2 1 - X 2 


1 - X 2 ’ 


it is plain to show that 


X + Po , 1 - x 2 

-- tor r = Tg - - 

1 + H Po 1 + x Po 


The meaning of this is that a solution of problem (30) satisfies the 
estimate 

II Vn — M II < P n \\Vo ~ u II 

with 


(39) 


X + Po 
1 + XPo ’ 


X ~ 


Iz 

\h\ 72 + 7 3 2 ’ 


T — T ~ 


T o (1 - X 2 ) 
1 + xp 0 
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provided that conditions (34) hold. The number n of iterations for doing 
so is no less than n Q {e)\ 

n > n o(£) > In ~/^ n ~ • 

What can happen upon replacing the describing explicit scheme by an 
implicit one? Being concerned with one of the implicit schemes 

( 40 ) B Vk+1 ~ yk +Ay k = f, k = 0,1,2,..., y 0 e H , 

T k+1 

with a self-adjoint operator B = B* > 0, the intention is to employ the 
explicit scheme 


x k +i = x k - T ( Cx k - <p), x k = BL/2 Vk, 
with the members 

C = B~ 1 / 2 AB- 1/ ' 2 , p = B~ 1/2 f 


and rearrange conditions (34) with regard to the operator C as revised 
conditions for the operators A and B : 

(41) 7 1 B < A 0 < j 2 B , {B~ l A l y,A l y)<'yi(By,y), 

assuring 

\\ A iy\\ B -^ < JsMb and lli/n - U \\ B < P n lls/o - U \\b 

in contrast to the preceding estimate just established. 

The minimal residual method can be employed for the equation Au = 
f with a non-self-adjoint operator A, the convergence rate of which coin¬ 
cides with that of scheme (30) for r = t. 

For the explicit scheme (13) we have 


24+1 ~ Vk 

T k + l 


+ A Vk = / > ^=0,1,2,... , y 0 G H given, 


where the parameter r k+l is chosen by the approved rule 
_ (Ar k ,r k ) 


+1 


r k = Ay k - f , 
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(for more detail see Section 2, formula (14)) governing the minimum con¬ 
dition for || r k+1 || 2 . No property of the self-adjointness of the operator A 
applies here and below. In what follows minor changes will appear in con¬ 
nection with the necessity of proving its convergence. In particular, f will 
stand in place of r k+1 on the right-hand side of identity (16) and will result 
in the relations 

II r k+1 || 2 < || r k || 2 - 2 r (A r k ,r k ) + r 2 || Ar k || 2 

= IK ~ rAr k II 2 < \\E~ tA || 2 • |K || 2 
</KKlK 

thereby assuring || r k + 1 || < p\\ r k || and justifying the estimate 
\\Ay n -f\\ <p n \\Ay 0 -f\\. 

This is certainly true for the minimal residual method (13)—(14) under 
conditions (34). Here y n is a solution of problem (13) and p is specified by 
formula (39). The fastest move method is useless in that case because the 
operator A is non-self-adjoint in such a setting. 

Observe that under conditions (34) the estimate 

\\ A Vn ~ /IK-i < P n 11A !/o - /IK-i 

is valid for the implicit minimal correction method with B = B* > 0 
incorporated. 

5. Gibrid (combined) methods. In mastering the difficulties involved in 
solving difference elliptic equations, some consensus of opinion is to bring 
together direct and iterative methods in some or other aspects as well as 
to combine iterative methods of various types (two-step methods). All the 
tricks and turns will be clarified for the iteration scheme 

(42) B k ^±1 -— + Ay k = f, y 0 £ H given, 

T k +1 

yielding 

(43) y k+1 =y k - r k+1 w k , 

where w k is the correction satisfying the equation B k w k = r k and r k = 
Ay k — f is the residual. 
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Let now R = R* > 0 be a regularizer such that c^R < A < c 2 R, 
c j > 0. Knowing u^, it is plain to find the (k + l)th iteration y k+ i in line 
with (43), so there is some reason to be concerned about this. 

The operator Bu can be specified in a number of different ways and, 
in particular, in explicit form. One way of covering this is 

(44) B k = R, 


(45) 


B k = (E + wi 1 ) R 1 )(E + J^R 2 ), 


where R\_, R2 are economical operators and are iteration parame¬ 

ters. We dealt with the factorized operator (45) during the course of ATM 
with R\ = R* 2 , = ui as well as of ADM with R* a = R a > 0, 

ex ~ 1 , 2 , R\ if 2 — R2 Ri ■ 

a) A direct method for determination of the correction. Let B k = R 
and one of the available direct methods will be employed for solving the 
system of algebraic equations Rw = r k . We refer the users to Section 
1 (items 2-3) in which such methods have been designed for elliptic grid 
equations. Among them the decomposition method with ■y 1 = eg and 7 , = 
c 2 is highly recommended for practical implementations. By the selection 
rule for C'hebyshev’s parameters 77 , r 2 ,... , r n we derive the estimate for 
the number of the necessary iterations 


n > n 0 (s) , 


n 0 (e) 



In this regard, it should be noted that for the difference elliptic prob¬ 
lems posed in Section 3, item 7, n 0 (f) is independent of the grid step. What 
is more, when G is a rectangle and /i 1 = h 2 = h, the work in doing this is 



b) An iterative method for determination of the correction. The start¬ 
ing point for subsequent considerations is the equation Rw k = r k , which can 
be solved by means of some (internal) iterative method, whose use permits 
us to find = w k , where m is the number of the internal iteration. 

Further reduction of a two-layer iteration scheme with the accompa¬ 
nying self-adjoint operators to an explicit one by replacing the variable w 
by R l ! 2 w leads to 


- Tm i?i/2( w (o) _ j 
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where w is the exact solution to the equation Rw = r k and T m is the 
resolving operator subject to the relations 

(46) T; n = T m , ||T m ||<«<l. 

Here the dependence q upon m is omitted. This should cause no confusion. 
With the initial value u>(°) = 0 in view, we find that 

w = R~ l ! 2 {E - T m )~ 1 R}l 2 w (m 4 . 

Upon substituting this expression into the equation Rw = r k we obtain the 
equation Bw k = r k with the members 

B = R 1 ! 2 {E — T m )~ 1 R 1 / 2 , w k = w<- m \ 

thereby completing the task of searching for the correction. By the same 
token, y k+1 = y k - T k+1 w k . 

Still using the framework of the general theory, it is straightforward 
to verify that the operator B is self-adjoint (B — B*) with the aid of the 
relations R = R* and T* % = T m . We shall need yet the constants and 7 , 
of the energetic equivalence of the operators B and A. Beca.use of (46), we 
thus have 


(l-q)E<E-T m <(l + q)E, 

(1 + q)~ 1 E<{E-T m )- 1 <(1 -q)-' E, 

(Bx,x) = (R l l\E -T m y l R l ' 2 x,x) = [{E - T m )~ l y, y) , 

where y = R l ! 2 x. From such reasoning it seems clear that 

(1 -q)B < R< (l + q)E, 

0 0 

giving 7j = 1 — q and 7, = 1 + q and implying that ■y 1 = Cj(l — q) and 
I2 = Cj(l + 9). 

For Chebyshev’s scheme with such an operator we obtain 


1 / c 2 (1 + q) 2 

2 y A (l — q) e’ 


_ (! - (?) 
c -> (l + q) 


since 
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Methods for Solving Grid Equations 


If R = R\ + f? 2 , R* a = Ra > 0 and Ri R 2 = R 2 R\ ADM from Section 
4, items 2-3 may be employed, where the minimum condition for the work 
in connection with solving the equation Au — f guides a proper choice of 
the quantity q. 

When the spectrum of R happens to be unknown in advance, it seems 
worthwhile adapting iterative methods of variational type for determination 
of the correction. Unfortunately, in this book we have no possibility to say 
more about other combinations arising time and again in such matters. 



Symbols 


ui h = {x a - = ih, h > 0, i = 1,2,... , AT — 1, hN = /} - an equidistant 
(uniform) grid on the interval (0 ,/); 

w h = {*,- = ih, h > 0, i = 0,1,.. . , At, hN = /} - an equidistant (uniform) 

grid on the segment [0 ,/]; 

h - step of the grid oj h ; 

x = Xj - a node of the grid ui h \ 

y = y i = y(x { ) - a function defined on the grid ui h ; 

y x = — Vi)/h - the right difference derivative at a point xq; 

y x = {yj — y i _ 1 )/h - the left difference derivative at a point .xq; 

Vsx — {lli+i ~~ 2y j + y j _ 1 )/h 1 - the second difference derivative at a point 
x i, 

u> h = {xq £ (0, /), i = 1,2,... , N — 1} - a non-equidistant (nonuniform) 
grid on the interval (0 ,/); 

u>h = { x i £ [0, /], i — 0,1,... , At, x 0 = 0, x N = /} - a non-equidistant 
(nonuniform) grid on the segment [0 ,/]; 
hj = xq — x i _ l - step of the grid uj h ; 
h t = 0.5 {h t + h i+1 ); 

Vx = (Vi+i ~ Vi)/hi +1 , 

Vs = (Vi ~ Vi-xMK] 

Vi = (Vi+1 - Vi)/hf, 
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Symbols 


J_ / Vi+i ~ Vi __ Vi ~ Vi-i \ 

" /' 1 h i+1 K )' 

A list of inner products and associated norms on a grid: 

N -1 

{y,v)= E Vi v ih, II 2 /II = vE/E/); 

1 = l 
N 

(y, v] = E ViVih, ll«/]| = \J{y, y\, 

2 = 1 

II V lie = niax |t/(^)l; 

Xi€w h 

(N -1 , i \ 2 \ 172 

lkll ( _i)=(E J ; 

w T = {t- = jr, t > 0, j = 0, 1,. .. } - a grid in time; 
r - step of the grid ui T ; 

y = y J = y(tj) - a function defined on the grid uj t ; 

y = 1 /J+ 1 = y(t j+1 ), y = y j = y(tj^); 

fh = (y - y)/r, ft = {y- j/)/ r , y° = (ii - 60/( 2r ); 

Vtt -{y- 2 j/+ 2 /)/r 2 ; 

x = x { = ^ x[ n \ .... iEE . .. , *0 ) j - a node of the p-dimensional 
rectangular grid u> h \ 

— h j • 

■ tt ' 1 a 1 ot > 

/i a - step of the grid c o h along the direction a; 

x i ±U) = - z ( J a) ± K ,... , 

y-y(xi), y (±la) = y^i ±la) y, 

y Xa = ( y [+la) - y)/h a \ 

v Sa = {y-y { ~ la) )/h a \ 

y SaXa = (^ +1 “)- 2 y+y(- 1 “))// l 2 ; 

0 

Q - set of all grid functions given on the grid w h and vanishing on its 
boundary; 

H - Hilbert space; 

(y, u) - inner product of elements y, v £ H, and associated norm ||y|| = 

\/{y, */); 

T>(A) - domain of definition of an operator A; 

7Z(A) - range of values of an operator A; 

E - identity operator; 

A : H H - operator A with the domain V(A) = H and range 71(A) C H ; 
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A* - adjoint operator; 

A~ l - inverse operator; 

S - transition operator from one layer to another; 
T - resolving operator; 

A > 0 - positive operator; 

A > 0 - nonnegative operator; 

A > SE, S > 0, - positive definite operator; 

\\y\\ A = V( A y’ y)> y £ H ', 

IMU-i = V( A A, A), <p£H. 




Concluding Remarks 


In concluding this book we give a brief commentary regarding the main 
results forth in the foregoing. In order to make the book accessible not 
only to specialists, but also to students and engineers, we give in Chapter 1 
a complete account of definitions and notations and present a number of 
relevant topics from other branches of mathematics. The detailed outline 
of mathematical models leading to partial differential equations is available 
in many textbooks and monographs on equations of mathematical physics. 
In particular, we refer the reader to Courant and Hilbert (1953, 1962), Go¬ 
dunov (1971), Morse and Feshbach (1953), Tikhonov and Samarskii (1963). 
Current exposition follows the best legacies of the past: my first book with 
my dear teacher - the late Academ. Tikhonov “Equations of Mathemat¬ 
ical Physics”, throughout which the reader can find thorough, advanced- 
undergraduate to graduate level treatments of problems leading to partial 
differential equations: hyperbolic, parabolic, elliptic equations; wave prop¬ 
agations in space, heat conduction in space, special functions, etc. with 
emphasis on the mathematical formulation of problems, rigorous solutions, 
physical interpretation of the results obtained. 

The books by Gelfand (1967), Samarskii and Nikolaev (1989) cover in 
full details the general theory of linear difference equations. Sometimes the 
elimination method available for solving various systems of algebraic equa.- 
tions is referred to, in the foreign literature, as Thomas’ algorithm and this 
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Concluding Remarks 


should cause no confusion. This method was independently proposed by 
many authors in the early fifties. The bibliographical sources of Godunov 
and Ryabenkii (1964) and Richtmyer (1957) help clarify its appearance a lit¬ 
tle bit. Faddeev and Faddeeva (1963) have treated the elimination method 
as the well-established Gaussian elimination for systems of equations with 
a tridiagonal matrix. 

Most of the propositions in Chapters 2-4 are of independent value 
although, for the present book they are used only as part of the auxiliary 
mathematical apparatus. Some of them were known earlier a.ncl the rest 
were discovered and proven in recent years in connection with the rapid 
development of the theory of difference schemes. 

Relevant results from functional analysis, operator theory and the 
well-developed numerical methods are given at the very beginning of Chap¬ 
ter 2. All proofs af the main statements as well as a detailed exposition of 
the foundations of functional analysis, operator theory and the theory of 
difference schemes are outlined in the textbooks and monographs by Ames 
(1977), Mitchell and Griffits (1980), Morton and Mayers (1994), Ortega and 
Poole (1981), Samarskii (1987), Samarskii and Gulin (1989). The basic con¬ 
cepts, notions and mathematical apparatus of the contemporary theory of 
difference methods for solving mathematical physics problems completed in 
late fiftieth owe a debt to Forsythe and Wasow (1960), Richtmyer (1957), 
Richtmyer and Morton (1967), Ryabenkii and Filippov (1956). The the¬ 
orem on connection between approximation and stability of a difference 
scheme and its convergence to a solution of the original problem appeared 
in the works of Filippov (1955), Lax and Richtmyer (1956). 

The theory of homogeneous difference schemes for ordinary differential 
equations of second order with variable coefficients and, in particular, with 
discontinuous ones, was developed by A.N. Tikhonov and A.A. Samarskii 
in the middle of 50 th - in the early 60 th . The first results in this area 
were obtained by Tikhonov and Samarskii (1956). Later a, complete and 
systematic study was carried out by Tikhonov and Samarskii (1961) along 
these lines. Special investigations of convergence of difference schemes on 
non-equidistant grids have been done by Tikhonov and Samarskii (1961ab, 
1962). The monograph of Samarskii, Lazarov and Makarov (1987) includes 
more a detailed exploration of the theory of explicit difference schemes and 
schemes of any accuracy order for ordinary differential equations, while the 
original works of Alekseevskii (1984), Bagmut (1969), Chao Show (1963) 
and Prikazchikov (1.965) concentrate on special cases in tackling singular- 
perturbed problems, equations with singularity, some problems associated 
with a four-order equation and the Sturm-Liouville problem, respectively. 

The notion of the conservatism of a difference scheme played a crucial 
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role in the further recognition and establishment of convergence of homo¬ 
geneous difference schemes with discontinuous coefficients (for more detail 
see Tikhonov and Samarskii (1961ab)). It was shown therein that conser¬ 
vatism is a necessary property for convergence of a homogeneous scheme in 
the class of discontinuous coefficients. Further development of the conser¬ 
vatism principle provided by Samarskii and Popov (1969, 1992) gave rise 
to the notion of full conservatism. 

Being concerned with homogeneous conservative difference schemes, 
A.N. Tikhonov and A.A. Samarskii recommended the design of the ba¬ 
lance method being an integro-interpolation one and providing the neces¬ 
sary framework for constructing difference schemes on arbitrary irregular 
grids. Samarskii, Kolcloba, Poveshchenko, Tishkin and Favorskii (1966) 
followed these procedures in solving the global problems of mathematical 
physics under such an approach. We note in passing that the methods based 
on Marchuk’s identity and well-established by Babuska. et al. (1966) and 
Marchuk (1975) are conceptually close to the balance method mentioned 
above. A greater gain in accuracy of difference schemes on a sequence of 
grids were the main idea behind this approach justified in full details by 
Marchuk and Shajdurov (1979). 

Some modification of the describing monotone difference scheme for 
“divergent” second-order equations was made by Golant (1978) and Ka- 
retkina (1980). In Andreev and Savin (1995) this scheme applies equally 
well to some singular-perturbed problems. Various classes of monotone 
difference schemes for elliptic equations of second order were composed by 
Samarskii and Vabishchevich (1995), Vabishchevich (1994) by means of the 
regularization principle with concern of difference schemes. 




References 


Akhiezer, N. and Glazman, I. (1966) The Theory of Linear Operators in 
Hilbert Space. Nauka: Moscow (in Russian). 

Alekseevskii, M. (1984) Difference schemes of higher-order accuracy for 
some singular-perturbed boundary-value problems. Differential Equations, 
17, 1177-1183 (in Russian). 

Ames, W. (1977) Numerical Methods for Partial Differential Equations. 
Academic Press; New York-London. 

Andreev, V. and Savin, I. (1995) On the uniform convergence in a small 
parameter of Samarskii’ scheme and its modification. Zh. Vychisl. Mat. 
i Mat. Fiz., 35, 739-752 (in Russian); English transl. in USSR Comput. 
Mathem. and Mathem. Physics. 

Babuska, I., Pager, M. and Vitasek, E. (1966) Numerical Processes in Dif¬ 
ferential Equations. Wiley: Chichester. 

Bagmut, G. (1969) Difference schemes of higher-order accuracy for an ordi¬ 
nary differential equations with singularity. Zh. Vychisl. Mat. i Mat. Fiz., 
9, 221-226 (in Russian); English transl. in USSR Comput. Mathem. and 
Mathem. Physics. 

Balakrishnan, A. (1976) Applied Functional Analysis. Springer; New-York- 
Berlin-Heidelberg. 


753 



754 


References 


Berezanskij, Yu. (1968) Expansions in Eigenfunctions of Self-Adjoint Op¬ 
erator. AMS: Providence, RI. 

Bitsadze, A. (1976) Equations of Mathematical Physics. Nauka.: Moscow 
(in Russian). 

Cannon, J. (1984) The one-dimensional heat equation. In: Encyclopedia of 
Mathematics and Its Applications, v. 23, Addison-Wesley: Reading, MA. 

Chao Show (1963) Homogeneous difference schemes for a four order equa¬ 
tion with discontinuous coefficients. Zh. Vychi.sl. Mat. i Mat. Fiz., 5, 123— 
132 (in Russian); English transl. in USSR Comput. Mathem. and Ma.them. 
Physics. 

Oourant, R. and Hilbert, D. (1953) Methods of Mathematical Physics. Vol¬ 
ume 1. Wiley: New York. 

Courant, R. and Hilbert, D. (1962) Methods of Mathematical Physics. Vol¬ 
ume 2. Wiley: New York. 

Dezin, A. (1980) General Questions of the Theory of Boundary-Value Prob¬ 
lems. Nauka: Moscow (in Russian). 

Dunford, N. and Schwartz, J. (1971a) Linear Operators (second edition). 
Part I: General Theory. Wiley: New York. 

Dunford, N. and Schwartz, J. (1971b) Linear Operators (second edition). 
Part II: Spectral Theory. Self-Adjoint Operators in Hilbert Space. Wiley: 
New York. 

Faddeev, D. and Facldeeva, V. (1963) Computational Methods of Linear 
Algebra. Freeman&Co.: San Francisco. 

Filippov, A. (1955) On stability of difference equations. Dokl. Akad. Nauk 
SSSR, 100, 1045-1048 (in Russian); English transl. in Soviet Mathem. Dokl. 

Forsythe, G. and Wasow, W. (1960) Finite Difference Methods for Differ¬ 
ential Equations. Wiley: New York. 

Gelfand, A. (1967) Calculus of Finite Differences. Nauka: Moscow (in Rus¬ 
sian). 

Godunov, S. (1971) Equations of Mathematical Physics. Nauka: Moscow 
(in Russian). 

Godunov, S. and Ryabeukii, V. (1964) Introduction to the Theory of Dif¬ 
ference Schemes. Interscience: New York. 



References 


755 


Golant, E. (1978) On conjugate families of difference schemes for equations 
of parabolic type with lower members. Zh. Vychisl. Mat. i Mat. Fiz., 18, 
1162-1169 (in Russian); English transl. in USSR Comput. Mathem. and 
Mathem. Physics. 

Kantorovich, L. and Akilov, G. (1977) Functional Analysis in Normed 
Spaces. Nauka: Moscow (in Russian). 

Karetkina, N. (1980) Noncouditionally stable difference schemes for par¬ 
abolic equations with the first derivatives. Zh. Vychisl. Mat. i Mat. Fiz., 
20, 236-240 (in Russian); English transl. in USSR Comput. Mathem. and 
Mathem. Physics. 

Ladyzhenskajm, 0. (1973) Boundary Value Problems of Mathematical 
Physics. Nauka: Moscow (in Russian). 

Lax, P. and Riclitmyer, R. (1956) A servey of stability of linear finite dif¬ 
ference equations. Comm. Pure Appl. Mathem., 9, 267-293. 

Marchuk, G. (1975) Methods of Computational Mathematics. Springer: 
New York. 

Marchuk, G and Shajdurov, V. (1979) Gain in Accuracy of Difference 
Schemes. Nauka: Moscow (in Russian). 

Mitchell, A. and Griffits, D. (1980) The Finite Difference Methods in Partial 
Differential Equations. Wiley: New York. 

Morozov, V. (1984) Regularization Methods for Solving Improperly Posed 
Problems. Springer: New-York-Berlin-Heidelberg. 

Morse, P. and Feshbach H. (1953) Methods of Theoretical Physics. Volumes 
1,2. McGraw Hill: New York. 

Morton, K. and Mayers, D. (1994) Numerical Solution of Partial Differential 
Equations. An Introduction. Cambridge University Press: Cambridge. 

Ortega, Y. and Poole, W. (1981) An Introduction to Numerical Methods 
for Differential Equations. Pitman: London. 

Prikazchikov, V. (1965) A difference problem on eigenvalues of an elliptic 
operator. Zh. Vychisl. Mat. i Mat. Fiz., 5, 648-657 (in Russian); English 
transl. in USSR Comput. Mathem. and Mathem. Physics. 

Richtmyer, R. (1957) Difference Methods for Initial-Value Problems. Inter¬ 
science: New York. 

Richtmyer, R. (1978) Principles of Advanced Mathematical Physics. Vol¬ 
ume 1. Springer: New York-Berlin-Heidelberg. 



756 


References 


Richtmyer, R. (1981) Principles of Advanced Mathematical Physics. Vol¬ 
ume 2. Springer: New York-Berlin-Heidelberg. 

Richtmyer, R. and Morton, K. (1957) Difference Methods for Initial-Value 
Problems. Interscience: New York. 

Ryabenkii, V. and Filippov, A. (1956) On Stability of Difference Equations. 
Gostekhizdat: Moscow (in Russian). 

Samarskii, A. (1987) Introduction to Numerical Methods. Nauka: Moscow 
(in Russian). 

Samarskii, A. and Gulin, A. (1989) Numerical Methods. Nauka: Moscow 
(in Russian). 

Samarskii, A. and Popov, Yu. (1969) Totally conservative difference sche¬ 
mes. Zh. Vychisl. Mat. i Mat. Fiz., 9, 953-954 (in Russian); English transl. 
in USSR Comput. Mathem. and Mat hem. Physics. 

Samarskii, A. and Popov, Yu. (1992) Difference Methods for Solving Prob¬ 
lems in Gas Dynamics. Nauka: Moscow (in Russian). 

Samarskii, A. and Vabishchevich, P. (1995) Computational Heat Transfer 
(Volumes 1,2). Wiley: Chichester. 

Samarskii, A., Koldoba, A., Poveshchenko, Yu., Tishkin V. and Favorskii, 
A. (1966) Difference Schemes on Irregular Grids. Nauka: Minsk (in Rus¬ 
sian). 

Samarskii, A., Lazarov, R. and Makarov, V. (1987) Difference Schemes for 
Differential Equations with Generalized Solutions. Visha Schkola: Moscow 
(in Russian). 

Tikhonov, A. and Samarskii, A. (1956) On difference schemes for equations 
with discontinuous coefficients. Dokl. Akad. Nauk SSSR, 109, 393-396 (in 
Russian); English transl. in Soviet. Mathem. Dokl. 

Tikhonov, A. and Samarskii, A. (1963) Equations of Mathematical Physics. 
Pergamon Press: New York-London. 

Tikhonov, A. and Samarskii, A. (1961a) On homogeneous difference sche¬ 
mes. Zh. Vychisl. Mat. i Mat. Fiz., 1, 5-63 (in Russian); English transl. in 
USSR Comput. Mathem. and Mathem. Physics. 

Tikhonov, A. and Samarskii, A. (1961b) Homogeneous difference schemes 
of higher-order accuracy on non-equidista.nt grids. Zh. Vychisl. Mat. i Mat. 
Fiz., 1, 425-440 (in Russian); English transl. in USSR Comput. Mathem. 
and Mathem. Physics. 



References 


757 


Tikhonov, A. and Samarskii, A. (1962) Homogeneous difference schemes on 
non-equidistant grids. Zh. Vychisl. Mat. i Mat. Fiz., 2, 812-832 (in Russian); 
English transl. in USSR Comput. Mathem. and Mathem. Physics. 

Trenogin, V. (1980) Functional Analysis. Nauka: Moscow (in Russian). 

Vabishchevich, P. (1994) Monotone difference schemes for convection-diffu¬ 
sion problems. Differential Equations, 30, 503-531 (in Russian). 

Vladimirov, V. (1971) Equations of Mathematical Physics. Nauka: 
Moscow (in Russian). 

Vladimirov, V. (1976) Distributions in Mathematical Physics. Nauka: 
Moscow (in Russian). 

Yosida, K. (1965) Functional Analysis. Springer: New York-Berlin-Ifeidel- 
berg. 




Index 


Approximation: 
difference, 56 

difference of order m, 56, 69, 73 
exact, 74 

summarized (summed), 691 
A priori estimate, 97, 203, 420, 448 
Cauchy-Bunyakovskii inequality, 
101 

Condition: 

Courant, 376 
first boundary, 8 
norm concordance, 56 
periodicity, 179 
second boundary, 8 
third boundary, 8 
p-stability, 411 
Difference: 
left, 2 
right, 2 

Difference analog of the second 
Green formula, 101 
Difference derivative: 
central, 57 
left, 57 
right, 57 

Difference problem: 

Dirichlet, 252 


ill-posed, 127 
well-posed, 96 

Difference scheme, 74, 78, 126 
additive, 598, 618 
alternating direction, 547 
best, 168, 169 
conservative, 150 
co-equivalent, 231 
co-stable, 230 
Crank-Nicolson, 303 
disbalanced, 150 
Du-Fort-Frankel, 324 
Duglas-Rachford, 629 
economical, 349, 619 
explicit, 76, 302, 345, 358, 386 
388 

explicit iteration, 657 
factorized, 565 
forward, 302 
fully conservative, 532 
higher-accuracy, 207, 290 
homogeneous, 146, 147 
implicit, 76, 386, 388 
implicit iteration, 657 
locally one-dimensional, 600 
monotone, 183 
nonconservative, 150 
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Index 


[Difference scheme] 

Peaceman-Rachford, 548 
predictor-corrector, 522 
purely implicit, 302 
Richardson, 323 
"rhombus", 324 
r-layer 

stable, 132, 306, 429 
asymptotically, 329 
conditionally, 310 
in every harmonic, 309 
unconditionally, 310, 334 
with respect to coefficients, 
230 

with increased accuracy, 347 
symmetric, 303 
three-layer, 86, 353, 445 
truncated, 213 
two-layer, 302, 386 
with variable operators, 347 
well-posed, 388 
weighted, 301, 346, 441 
Domain of operator, 42 
Eigenvalue of an operator, 49 
Eigenvector of an operator, 49 
Energy: 

identity, 318, 399, 430 
inequality, 319 
Energy of an operator, 44 
Error of the difference approxi¬ 
mation, 57, 69, 159 
Equation: 

difference, 2 

first-order linear, 4, 5 
/nth-order linear, 3 
second-order linear, 4, 7 
elliptic, 237 
heat conduction, 300 
hyperbolic, 84 
operator, 140 
Poisson, 237, 290 
quasilinear, 300 
Schrodinger, 349 
stationary, 187 
time-dependent, 299 
transfer, 354 


vibrations, 364 
Formulae: 

"difference differentiation" by 
parts, 29 
first Green, 32 
second Green, 32 
Function: 

difference Green, 199 
grid, 2, 51 
pattern, 208 
Grid, 2, 51, 246, 248 
connected, 250, 259 
equidistant, 51 
non-equidistant, 52, 67 
rectangular, 246 
square, 246 
Grid step, 51 
Harmonic, 308 
Input data, 87 
Iterations, 653 
Kronecker’s delta, 201 
Lattice, 2 
Layer, 302 

Lipschitz continuity of an operator, 
420 

Majorant, 16, 262 

Maximum principle, 15, 20, 260 

Method: 

alternating direction, 711 
alternative-triangle, 684 
Bubnov-Galerkin, 221 
counter elimination, 13 
cyclic elimination, 37 
decomposition, 645 
energy inequality, 113, 316, 
374 

factorization, 39 
integro-interpolation, 150, 215 
left elimination, 13 
matrix elimination, 651 
minimal correction, 733 
minimal residual, 733 
Newton, 517 

n-layer composite of period m, 
618 

one-step iterative, 653 
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[Method] 

right elimination, 10 
Ritz, 221 
Seidel, 676 

separation of variables, 406 
simple iteration, 664 
steepest descent, 734 
summator identities, 228 
test function, 150 
two-step iterative, 653 
upper relaxation, 678 
Model, 666 

Neighborhood of a node, 256 
Nodes, 2, 51, 245, 248 
adjacent, 52 

boundary, 53, 246, 249, 258, 
703 

inner, 53, 246, 249, 258, 703 
irregular, 249, 250 
near-boundary, 249, 250 
strictly inner, 250 
Norm of an operator, 42 
Operator: 

additive, 42 
adjoint, 44 
bounded, 42 
commuting, 43 
homogeneous, 42 
inverse, 43 
Laplace, 238, 280 
linear, 42 
resolving, 391 
self-adjoint, 44 
skew-symmetric, 425 
transition, 386, 391 
"triangular", 457 
Operator-difference scheme, 384 
Pattern, 56 


"cross," 241 
integral, 146 
irregular, 67 

Pattern functional, 146, 147 
Primary family, 146, 156, 398 
Problem: 

boundary-value, 7, 75, 82, 108, 
120, 136, 360 
Cauchy, 7, 74, 75 
eigenvalue, 106, 108, 278 
periodic, 496 
stable with respect to the 

initial data and right-hand 
side, 384 
stationary, 507 
Stephan, 523 
well-posed, 96, 232 
Range of an operator, 42 
Regular behaviour, 329 
Regularization, 454 
Regularization principle, 575 
Regularizator, 455 
Square root of an operator, 45 
Stability: 

absolute, 389 
asymptotic, 329 
strong, 232 

with respect to coefficients, 232 
with respect to the initial data, 
389, 403 

with respect to the right-hand 
side, 389, 411 
Temperature wave, 514 
Theorem: 

comparison, 16, 262 
difference embedding, 110, 112, 
281 

"Through execution" algorithm, 691 



